Jul 06 19:05:10.546349 ip-10-0-142-12 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:05:11.018810 ip-10-0-142-12 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:05:11.018810 ip-10-0-142-12 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:05:11.018810 ip-10-0-142-12 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:05:11.018810 ip-10-0-142-12 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:05:11.018810 ip-10-0-142-12 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:05:11.020140 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.019661 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024616 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024628 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024632 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024635 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024638 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024641 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024644 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024647 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024650 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024652 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024655 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024657 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024661 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024663 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024666 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024672 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024676 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024679 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:11.077857 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024682 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024685 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024687 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024690 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024693 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024696 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024698 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024701 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024703 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024706 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024709 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024711 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024714 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024716 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024719 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024722 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024724 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024727 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024730 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024732 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:11.085007 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024736 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024739 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024741 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024744 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024747 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024751 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024756 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024758 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024763 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024766 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024769 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024771 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024774 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024777 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024779 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024782 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024785 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024787 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024790 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:11.086135 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024793 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024795 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024798 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024800 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024803 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024805 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024808 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024810 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024813 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024816 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024818 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024821 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024823 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024826 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024829 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024831 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024834 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024836 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024839 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024843 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:11.086762 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024846 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024848 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024850 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024853 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024855 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024858 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024861 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024863 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024866 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024869 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024871 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024874 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024878 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024880 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024883 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024885 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024887 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024890 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024892 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024895 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:11.087424 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024897 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.024901 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025586 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025594 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025597 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025600 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025602 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025605 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025608 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025611 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025613 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025616 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025618 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025622 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025624 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025627 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025630 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025633 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025636 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025639 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:11.088123 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025641 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025644 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025646 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025650 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025654 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025656 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025659 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025661 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025664 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025668 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025672 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025675 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025677 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025680 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025683 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025687 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025690 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025693 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025695 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:11.088991 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025698 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025700 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025703 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025705 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025708 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025710 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025713 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025717 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025720 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025723 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025725 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025728 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025730 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025733 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025735 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025738 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025740 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025743 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025747 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025750 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:11.089861 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025752 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025755 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025757 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025760 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025763 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025765 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025767 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025770 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025773 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025776 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025778 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025781 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025783 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025786 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025788 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025791 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025793 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025795 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025798 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025801 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:11.090713 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025804 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025806 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025809 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025813 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025815 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025818 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025822 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025827 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025830 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025833 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025835 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025838 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025840 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025843 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025846 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025848 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025851 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025853 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025856 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025859 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:11.091357 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025861 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.025864 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028052 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028062 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028066 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028069 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028072 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028075 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028096 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028105 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028108 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028110 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028120 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028123 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028128 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028131 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028134 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028139 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028142 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028145 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:11.092262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028148 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028151 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028153 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028156 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028159 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028162 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028167 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028170 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028173 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028175 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028178 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028181 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028183 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028186 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028189 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028191 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028194 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028197 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028199 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028204 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:11.093327 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028207 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028209 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028212 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028214 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028217 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028220 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028223 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028226 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028229 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028233 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028236 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028239 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028246 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028250 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028253 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028255 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028260 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028267 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028270 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:11.094405 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028273 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028276 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028279 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028283 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028289 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028292 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028294 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028298 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028300 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028303 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028306 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028308 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028311 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028313 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028316 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028319 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028324 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028327 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028331 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028335 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:11.095267 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028339 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028342 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028347 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028351 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028354 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028357 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028360 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028366 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028368 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028372 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028374 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028377 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028379 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028382 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028385 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028387 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028390 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028393 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028395 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:11.096559 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028398 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028403 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.028405 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028492 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028500 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028510 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028514 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028526 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028529 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028534 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028539 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028544 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028547 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028554 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028558 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028562 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028565 2577 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028568 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028571 2577 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028574 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028578 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028582 2577 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028588 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028591 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:05:11.097445 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028594 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:05:11.097648 ip-10-0-142-12 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028598 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028601 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028605 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028608 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028611 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028616 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028619 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028623 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028626 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028629 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028633 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028636 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028639 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028645 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028648 2577 flags.go:64] FLAG: --enable-server="true" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028651 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028656 2577 flags.go:64] FLAG: --event-burst="100" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028659 2577 flags.go:64] FLAG: --event-qps="50" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028664 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028666 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028670 2577 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028674 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028684 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028688 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:05:11.098727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028691 2577 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028694 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028698 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028701 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028704 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028707 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028712 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028715 2577 flags.go:64] FLAG: --feature-gates="" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028719 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028722 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028726 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028729 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028733 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028736 2577 flags.go:64] FLAG: --help="false" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028747 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028751 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028755 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028758 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028762 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028765 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028768 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028771 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028777 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:05:11.099774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028780 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028783 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028786 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028791 2577 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028794 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028797 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028800 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028805 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028810 2577 flags.go:64] FLAG: --lock-file="" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028813 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028817 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028820 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028825 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028829 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028832 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028835 2577 flags.go:64] FLAG: --logging-format="text" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028838 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028844 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028847 2577 flags.go:64] FLAG: --manifest-url="" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028850 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028855 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028858 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028863 2577 flags.go:64] FLAG: --max-pods="110" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028866 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028869 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:05:11.100883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028874 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028877 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028880 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028883 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028886 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028893 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028896 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028906 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028909 2577 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028912 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028918 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028922 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028926 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028929 2577 flags.go:64] FLAG: --port="10250" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028933 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028939 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0201e2285cca50d3e" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028943 2577 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028946 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028949 2577 flags.go:64] FLAG: --register-node="true" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028952 2577 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028956 2577 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028959 2577 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028962 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028965 2577 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028971 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:05:11.102417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028974 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028977 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028980 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028983 2577 flags.go:64] FLAG: --runonce="false" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028986 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028989 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028992 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.028997 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029000 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029004 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029007 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029010 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029013 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029015 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029018 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029021 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029026 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029029 2577 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029034 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029040 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029043 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029047 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029054 2577 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029057 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029061 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:05:11.103488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029067 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029071 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029074 2577 flags.go:64] FLAG: --v="2" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029096 2577 flags.go:64] FLAG: --version="false" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029102 2577 flags.go:64] FLAG: --vmodule="" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029109 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029112 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029323 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029327 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029330 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029333 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029336 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029339 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029342 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029344 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029347 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029350 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029352 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029355 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029358 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029363 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:11.168418 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029366 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029369 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029371 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029374 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029380 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029383 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029386 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029390 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029392 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029395 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029398 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029403 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029406 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029409 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029411 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029414 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029417 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029430 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029433 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029436 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:11.169251 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029438 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029441 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029443 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029446 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029451 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029454 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029457 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029460 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029463 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029466 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029468 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029471 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029474 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029476 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029479 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029482 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029486 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029491 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029493 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029497 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:11.170810 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029500 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029503 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029506 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029509 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029512 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029515 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029518 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029520 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029523 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029529 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029531 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029535 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029539 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029542 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029545 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029548 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029551 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029554 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029556 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:11.171571 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029559 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029561 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029566 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029572 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029575 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029578 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029581 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029584 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029587 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029591 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029593 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029596 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029600 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029603 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029607 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029614 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029617 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029620 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029623 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:11.172392 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029626 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029628 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029631 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029634 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029636 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029639 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.029642 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.029650 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.036921 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.036937 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.036950 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.036959 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037015 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037022 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:11.173015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037026 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037029 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037033 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037036 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037039 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037042 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037045 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037048 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037050 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037053 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037056 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037059 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037062 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037066 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037069 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037072 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037075 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037078 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037097 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037100 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:11.173837 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037103 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037106 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037109 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037112 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037115 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037118 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037120 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037123 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037125 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037128 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037130 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037133 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037136 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037138 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037141 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037143 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037146 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037149 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037151 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037154 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:11.174387 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037156 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037158 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037161 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037164 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037167 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037169 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037172 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037175 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037177 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037180 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037182 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037185 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037187 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037190 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037193 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037195 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037199 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037203 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037207 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:11.175206 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037210 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037213 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037216 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037218 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037221 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037223 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037226 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037228 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037231 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037234 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037236 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037239 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037241 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037244 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037246 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037249 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037254 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037257 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037259 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037264 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:11.175704 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037267 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037269 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037272 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037274 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037277 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037280 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037282 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037285 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037288 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037290 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037293 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037296 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037298 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037300 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037303 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037305 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037308 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:11.176299 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037311 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.037316 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037440 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037448 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037452 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037456 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037460 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037463 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037467 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037471 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037475 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037479 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037485 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037489 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037494 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:11.250068 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037498 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037501 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037505 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037510 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037514 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037518 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037522 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037526 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037529 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037534 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037537 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037542 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037546 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037550 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037554 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037558 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037561 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037565 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037569 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037573 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:11.250909 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037577 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037580 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037584 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037588 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037592 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037596 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037599 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037602 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037606 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037613 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037618 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037623 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037627 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037631 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037634 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037638 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037642 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037646 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037649 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:11.251611 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037653 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037657 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037661 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037665 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037668 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037673 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037676 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037680 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037684 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037687 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037691 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037695 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037699 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037702 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037707 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037711 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037714 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037717 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037719 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037724 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:11.252278 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037729 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037733 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037738 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037742 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037747 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037751 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037754 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037758 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037762 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037767 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037771 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037776 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037780 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037784 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037787 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037791 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037796 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037801 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037807 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:11.252841 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037811 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037815 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037819 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037823 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037827 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037831 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037834 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:11.037838 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.037845 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.037988 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.040418 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.041773 2577 server.go:1019] "Starting client certificate rotation" Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.041878 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:05:11.253416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.041907 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.044564 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.046008 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.060850 2577 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.064514 2577 log.go:25] "Validated CRI v1 image API" Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.065243 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.067958 2577 fs.go:135] Filesystem UUIDs: map[1cb834f0-bf03-4374-b34f-8e7073fd4295:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7ddc0c8f-1876-46d4-bb4e-4db5f817dfb1:/dev/nvme0n1p3] Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.067980 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:05:11.254042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.073518 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.076291 2577 manager.go:216] Machine: {Timestamp:2026-07-06 19:05:11.07448248 +0000 UTC m=+0.397217567 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098856 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d28db9040a675e7e6e59281a1627d SystemUUID:ec2d28db-9040-a675-e7e6-e59281a1627d BootID:96f1a7a0-45f5-45ad-ae06-7bc6f964073b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:42:f3:93:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:42:f3:93:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:79:b5:95:e8:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.076437 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.076561 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.079404 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.079433 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.080136 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.080147 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.080154 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.080754 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.082155 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085122 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085274 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085310 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085325 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085340 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085355 2577 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085368 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:05:11.254485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085891 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.085920 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.088219 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.090342 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.090385 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091585 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091605 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091615 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091623 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091635 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091644 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091656 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091664 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091674 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091693 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091706 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091715 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091746 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.091755 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.095883 2577 server.go:1268] "Started kubelet" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.095949 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.096428 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.096495 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.097601 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.099288 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.100415 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.100431 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.100531 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.103372 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.107245 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.107259 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.107317 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.107779 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.107873 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.107891 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108024 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108032 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108188 2577 factory.go:55] Registering systemd factory Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108203 2577 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108364 2577 factory.go:153] Registering CRI-O factory Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108381 2577 factory.go:223] Registration of the crio container factory successfully Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108429 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108450 2577 factory.go:103] Registering Raw factory Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108465 2577 manager.go:1196] Started watching for new ooms in manager Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.108876 2577 manager.go:349] Starting recovery of all containers Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.116415 2577 manager.go:354] Recovery completed Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.121020 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.255120 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.122176 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.122207 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.122965 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wc6jl" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.123288 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.123319 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.123336 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.122409 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-12.ec2.internal.18bfc8c18dd5d563 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-12.ec2.internal,UID:ip-10-0-142-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-12.ec2.internal,},FirstTimestamp:2026-07-06 19:05:11.095850339 +0000 UTC m=+0.418585428,LastTimestamp:2026-07-06 19:05:11.095850339 +0000 UTC m=+0.418585428,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-12.ec2.internal,}" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.124025 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.124038 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.124055 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.124324 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.125225 2577 policy_none.go:49] "None policy: Start" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.125248 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.125260 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.125889 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.125916 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.125926 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.127478 2577 policy_none.go:47] "Start" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.128016 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wc6jl" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.207404 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250014 2577 manager.go:337] "Starting Device Plugin manager" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.250044 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250054 2577 server.go:87] "Starting device plugin registration server" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250335 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250351 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250439 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250520 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.250528 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.251039 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:05:11.256431 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.251099 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.327966 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-12.ec2.internal\" not found" node="ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.335480 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.336629 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.336660 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.336680 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.336719 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:05:11.345344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.339334 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.351279 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.352345 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.352370 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.352379 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.352410 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.361118 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.363063 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.361135 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-12.ec2.internal\": node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.444947 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.385857 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.719196 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal"] Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.719208 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.719245 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.719978 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.720004 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.720015 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721261 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721417 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721881 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721901 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721903 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721923 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721933 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.721909 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.723013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.723034 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.726409 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.726431 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.726440 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.763543 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-12.ec2.internal\" not found" node="ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.799863 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.768041 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-12.ec2.internal\" not found" node="ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.819980 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.820023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cf9d28c09d100896579d38a5deeb770-config\") pod \"kube-apiserver-proxy-ip-10-0-142-12.ec2.internal\" (UID: \"3cf9d28c09d100896579d38a5deeb770\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.820171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0ed51d9364ae62e3a06389f9323db96-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal\" (UID: \"e0ed51d9364ae62e3a06389f9323db96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.820187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0ed51d9364ae62e3a06389f9323db96-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal\" (UID: \"e0ed51d9364ae62e3a06389f9323db96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:11.920207 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.920250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cf9d28c09d100896579d38a5deeb770-config\") pod \"kube-apiserver-proxy-ip-10-0-142-12.ec2.internal\" (UID: \"3cf9d28c09d100896579d38a5deeb770\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.920276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0ed51d9364ae62e3a06389f9323db96-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal\" (UID: \"e0ed51d9364ae62e3a06389f9323db96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.920298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0ed51d9364ae62e3a06389f9323db96-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal\" (UID: \"e0ed51d9364ae62e3a06389f9323db96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.920363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cf9d28c09d100896579d38a5deeb770-config\") pod \"kube-apiserver-proxy-ip-10-0-142-12.ec2.internal\" (UID: \"3cf9d28c09d100896579d38a5deeb770\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.920408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0ed51d9364ae62e3a06389f9323db96-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal\" (UID: \"e0ed51d9364ae62e3a06389f9323db96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:11.924811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:11.920444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0ed51d9364ae62e3a06389f9323db96-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal\" (UID: \"e0ed51d9364ae62e3a06389f9323db96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:12.020514 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:12.020486 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:12.041604 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.041576 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:05:12.041738 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.041722 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:05:12.079750 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.079728 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:12.079812 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.079737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" Jul 06 19:05:12.121287 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:12.121262 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:12.131645 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.131604 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:00:11 +0000 UTC" deadline="2028-03-27 16:56:52.98330684 +0000 UTC" Jul 06 19:05:12.131645 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.131639 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15117h51m40.851671185s" Jul 06 19:05:12.143542 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.142999 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:12.221442 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:12.221370 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:12.321774 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:12.321737 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-12.ec2.internal\" not found" Jul 06 19:05:12.357221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.357191 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:12.407670 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.407629 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" Jul 06 19:05:12.419499 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.419476 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:05:12.420539 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.420526 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" Jul 06 19:05:12.431692 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.431676 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:05:12.664810 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.664784 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:12.728843 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:12.728812 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf9d28c09d100896579d38a5deeb770.slice/crio-a47b16a759b3e7afb56b1d43727d8340c60c22549c7aefd27d56941163cd6b59 WatchSource:0}: Error finding container a47b16a759b3e7afb56b1d43727d8340c60c22549c7aefd27d56941163cd6b59: Status 404 returned error can't find the container with id a47b16a759b3e7afb56b1d43727d8340c60c22549c7aefd27d56941163cd6b59 Jul 06 19:05:12.733507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:12.733492 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:05:12.739363 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:12.739343 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ed51d9364ae62e3a06389f9323db96.slice/crio-5134ebba3aed966fc6087fc2e63c61c1c7f836a3417f4f91f356a3eec13c4b47 WatchSource:0}: Error finding container 5134ebba3aed966fc6087fc2e63c61c1c7f836a3417f4f91f356a3eec13c4b47: Status 404 returned error can't find the container with id 5134ebba3aed966fc6087fc2e63c61c1c7f836a3417f4f91f356a3eec13c4b47 Jul 06 19:05:13.086741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.086664 2577 apiserver.go:52] "Watching apiserver" Jul 06 19:05:13.096616 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.096595 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:05:13.096970 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.096948 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j","openshift-cluster-node-tuning-operator/tuned-8nfpx","openshift-dns/node-resolver-4xg6g","openshift-multus/multus-2cr9z","openshift-multus/multus-additional-cni-plugins-5kcdz","openshift-multus/network-metrics-daemon-kj9q9","kube-system/konnectivity-agent-wcmdx","openshift-image-registry/node-ca-lxg4q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal","openshift-network-diagnostics/network-check-target-vqgc5","openshift-network-operator/iptables-alerter-5sncc","openshift-ovn-kubernetes/ovnkube-node-jjxq8","kube-system/global-pull-secret-syncer-7l5n8","kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal"] Jul 06 19:05:13.099714 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.099693 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.101652 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.101625 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.101737 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.101688 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:13.102365 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.102347 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:05:13.102542 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.102528 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5qmrt\"" Jul 06 19:05:13.102614 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.102597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:05:13.104558 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.104537 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.106727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.106704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.106815 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.106797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rg6tk\"" Jul 06 19:05:13.107009 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.106992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.107105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.106992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.108098 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.108071 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:05:13.108919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.108904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.109075 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.109046 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.109417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.109396 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:05:13.109494 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.109395 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:05:13.109494 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.109464 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-79fmx\"" Jul 06 19:05:13.109494 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.109478 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.111199 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.111182 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.111286 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.111262 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:13.112455 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.112438 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:05:13.112523 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.112455 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vsqh8\"" Jul 06 19:05:13.112577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.112456 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:05:13.113270 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.113254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.115691 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.115674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:05:13.115783 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.115715 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9htb5\"" Jul 06 19:05:13.115783 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.115758 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.115877 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.115829 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.116161 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.116147 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.118019 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.118000 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.118155 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.118137 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:05:13.118335 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.118310 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.118394 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.118356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w7z95\"" Jul 06 19:05:13.118394 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.118385 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.122344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.122314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:13.122454 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.122384 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:13.122454 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.122444 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.122565 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.122527 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kn4bb\"" Jul 06 19:05:13.122730 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.122688 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.123099 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.123046 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:05:13.124594 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.124575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.125553 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-hostroot\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.125623 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb46a76a-5cba-483c-9567-d1a84ed73e5a-konnectivity-ca\") pod \"konnectivity-agent-wcmdx\" (UID: \"eb46a76a-5cba-483c-9567-d1a84ed73e5a\") " pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.125623 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.125696 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a461fdf-115d-46c3-8bde-d9bc2e953182-cni-binary-copy\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.125696 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1b22251-5299-42cf-9373-759be5b5ae9c-kubelet-config\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.125767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-cnibin\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.125767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-k8s-cni-cncf-io\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.125767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a669b24a-1165-42d2-b60f-8bc7255f85b9-hosts-file\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.125919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-conf-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.125919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-cnibin\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.125919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.125919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.125919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhk98\" (UniqueName: \"kubernetes.io/projected/a669b24a-1165-42d2-b60f-8bc7255f85b9-kube-api-access-bhk98\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.125919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-system-cni-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-cni-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-system-cni-dir\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.125980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-multus-certs\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqts\" (UniqueName: \"kubernetes.io/projected/1a461fdf-115d-46c3-8bde-d9bc2e953182-kube-api-access-brqts\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-os-release\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-socket-dir-parent\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-netns\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-cni-bin\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-cni-multus\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb46a76a-5cba-483c-9567-d1a84ed73e5a-agent-certs\") pod \"konnectivity-agent-wcmdx\" (UID: \"eb46a76a-5cba-483c-9567-d1a84ed73e5a\") " pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-kubelet\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-daemon-config\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-etc-kubernetes\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plkjd\" (UniqueName: \"kubernetes.io/projected/e21d6797-d239-4c0c-9446-0603259981b4-kube-api-access-plkjd\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a669b24a-1165-42d2-b60f-8bc7255f85b9-tmp-dir\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1b22251-5299-42cf-9373-759be5b5ae9c-dbus\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.126495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-os-release\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.126911 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.126898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.127590 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.127445 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qb556\"" Jul 06 19:05:13.127590 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.127483 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.127590 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.127483 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.127590 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.127520 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:05:13.129559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.129543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:05:13.129559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.129543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:05:13.129697 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.129648 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:05:13.129697 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.129674 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xlqm9\"" Jul 06 19:05:13.130060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.130033 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:05:13.130060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.130049 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:05:13.131133 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.131119 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:05:13.148892 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.148872 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-htshj" Jul 06 19:05:13.156262 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.156244 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-htshj" Jul 06 19:05:13.209492 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.209463 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:05:13.226758 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98h7b\" (UniqueName: \"kubernetes.io/projected/75e44a91-97d0-4697-86f9-d018aa5972d5-kube-api-access-98h7b\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.226904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhk98\" (UniqueName: \"kubernetes.io/projected/a669b24a-1165-42d2-b60f-8bc7255f85b9-kube-api-access-bhk98\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.226904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-cni-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.226904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-system-cni-dir\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.226904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.226904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-sys\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.226904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f59943a-5b9e-42e5-95af-df6d051b0988-ovn-node-metrics-cert\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226921 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-system-cni-dir\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-multus-certs\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.226997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-multus-certs\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqts\" (UniqueName: \"kubernetes.io/projected/1a461fdf-115d-46c3-8bde-d9bc2e953182-kube-api-access-brqts\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-os-release\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-socket-dir-parent\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-cni-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-cni-bin\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-os-release\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-socket-dir-parent\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-node-log\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-cni-bin\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-log-socket\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75e44a91-97d0-4697-86f9-d018aa5972d5-host\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-kubelet\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-etc-kubernetes\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-kubelet\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-kubernetes\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-kubelet\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-etc-kubernetes\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a669b24a-1165-42d2-b60f-8bc7255f85b9-tmp-dir\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-ovn\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-os-release\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-systemd\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-systemd\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-os-release\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.227740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-device-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-hostroot\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227729 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a669b24a-1165-42d2-b60f-8bc7255f85b9-tmp-dir\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb46a76a-5cba-483c-9567-d1a84ed73e5a-konnectivity-ca\") pod \"konnectivity-agent-wcmdx\" (UID: \"eb46a76a-5cba-483c-9567-d1a84ed73e5a\") " pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a461fdf-115d-46c3-8bde-d9bc2e953182-cni-binary-copy\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-hostroot\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-etc-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-ovnkube-script-lib\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khg56\" (UniqueName: \"kubernetes.io/projected/93695682-9372-498e-8bdb-bdfee90418b9-kube-api-access-khg56\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1b22251-5299-42cf-9373-759be5b5ae9c-kubelet-config\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-run\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f864901-7655-450f-9327-29029e38b5da-etc-tuned\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.227982 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1b22251-5299-42cf-9373-759be5b5ae9c-kubelet-config\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-run-netns\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.228496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-slash\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a669b24a-1165-42d2-b60f-8bc7255f85b9-hosts-file\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-conf-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-cnibin\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysctl-d\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a669b24a-1165-42d2-b60f-8bc7255f85b9-hosts-file\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228210 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-cnibin\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-var-lib-kubelet\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-conf-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-systemd-units\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-system-cni-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a461fdf-115d-46c3-8bde-d9bc2e953182-cni-binary-copy\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj9rb\" (UniqueName: \"kubernetes.io/projected/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-kube-api-access-nj9rb\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb46a76a-5cba-483c-9567-d1a84ed73e5a-konnectivity-ca\") pod \"konnectivity-agent-wcmdx\" (UID: \"eb46a76a-5cba-483c-9567-d1a84ed73e5a\") " pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75e44a91-97d0-4697-86f9-d018aa5972d5-serviceca\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.229021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e21d6797-d239-4c0c-9446-0603259981b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-netns\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-system-cni-dir\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-cni-multus\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkjd\" (UniqueName: \"kubernetes.io/projected/e21d6797-d239-4c0c-9446-0603259981b4-kube-api-access-plkjd\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-netns\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysctl-conf\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-var-lib-cni-multus\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1501e80c-7f30-459c-b9c4-d5344e0364fa-host-slash\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb46a76a-5cba-483c-9567-d1a84ed73e5a-agent-certs\") pod \"konnectivity-agent-wcmdx\" (UID: \"eb46a76a-5cba-483c-9567-d1a84ed73e5a\") " pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-daemon-config\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f864901-7655-450f-9327-29029e38b5da-tmp\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1501e80c-7f30-459c-b9c4-d5344e0364fa-iptables-alerter-script\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-lib-modules\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-host\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.229643 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwndq\" (UniqueName: \"kubernetes.io/projected/7f864901-7655-450f-9327-29029e38b5da-kube-api-access-wwndq\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1b22251-5299-42cf-9373-759be5b5ae9c-dbus\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-modprobe-d\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1b22251-5299-42cf-9373-759be5b5ae9c-dbus\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-cni-netd\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgzx\" (UniqueName: \"kubernetes.io/projected/1501e80c-7f30-459c-b9c4-d5344e0364fa-kube-api-access-kbgzx\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228859 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysconfig\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.228974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-cnibin\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-k8s-cni-cncf-io\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-var-lib-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-host-run-k8s-cni-cncf-io\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a461fdf-115d-46c3-8bde-d9bc2e953182-cnibin\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-ovnkube-config\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.230258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-cni-bin\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-env-overrides\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzn2s\" (UniqueName: \"kubernetes.io/projected/7f59943a-5b9e-42e5-95af-df6d051b0988-kube-api-access-dzn2s\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.229322 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.229413 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:13.729361475 +0000 UTC m=+3.052096570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a461fdf-115d-46c3-8bde-d9bc2e953182-multus-daemon-config\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229536 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.230739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.229653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e21d6797-d239-4c0c-9446-0603259981b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.232026 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.232011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb46a76a-5cba-483c-9567-d1a84ed73e5a-agent-certs\") pod \"konnectivity-agent-wcmdx\" (UID: \"eb46a76a-5cba-483c-9567-d1a84ed73e5a\") " pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.234414 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.234390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhk98\" (UniqueName: \"kubernetes.io/projected/a669b24a-1165-42d2-b60f-8bc7255f85b9-kube-api-access-bhk98\") pod \"node-resolver-4xg6g\" (UID: \"a669b24a-1165-42d2-b60f-8bc7255f85b9\") " pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.234510 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.234493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqts\" (UniqueName: \"kubernetes.io/projected/1a461fdf-115d-46c3-8bde-d9bc2e953182-kube-api-access-brqts\") pod \"multus-2cr9z\" (UID: \"1a461fdf-115d-46c3-8bde-d9bc2e953182\") " pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.239272 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.239247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plkjd\" (UniqueName: \"kubernetes.io/projected/e21d6797-d239-4c0c-9446-0603259981b4-kube-api-access-plkjd\") pod \"multus-additional-cni-plugins-5kcdz\" (UID: \"e21d6797-d239-4c0c-9446-0603259981b4\") " pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.330266 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-systemd\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330266 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-systemd\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-systemd\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-systemd\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-device-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-etc-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330507 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-ovnkube-script-lib\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khg56\" (UniqueName: \"kubernetes.io/projected/93695682-9372-498e-8bdb-bdfee90418b9-kube-api-access-khg56\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-run\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-etc-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f864901-7655-450f-9327-29029e38b5da-etc-tuned\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-device-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-run\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-run-netns\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-run-netns\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-slash\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysctl-d\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-var-lib-kubelet\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-slash\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.330917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-systemd-units\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-var-lib-kubelet\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330910 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-systemd-units\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj9rb\" (UniqueName: \"kubernetes.io/projected/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-kube-api-access-nj9rb\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75e44a91-97d0-4697-86f9-d018aa5972d5-serviceca\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.330997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysctl-conf\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysctl-d\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1501e80c-7f30-459c-b9c4-d5344e0364fa-host-slash\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f864901-7655-450f-9327-29029e38b5da-tmp\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1501e80c-7f30-459c-b9c4-d5344e0364fa-iptables-alerter-script\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-lib-modules\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-ovnkube-script-lib\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-host\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysctl-conf\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.331727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwndq\" (UniqueName: \"kubernetes.io/projected/7f864901-7655-450f-9327-29029e38b5da-kube-api-access-wwndq\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1501e80c-7f30-459c-b9c4-d5344e0364fa-host-slash\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-host\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-modprobe-d\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-cni-netd\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgzx\" (UniqueName: \"kubernetes.io/projected/1501e80c-7f30-459c-b9c4-d5344e0364fa-kube-api-access-kbgzx\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-modprobe-d\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysconfig\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75e44a91-97d0-4697-86f9-d018aa5972d5-serviceca\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-var-lib-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-sysconfig\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331479 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-ovnkube-config\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-cni-bin\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.332653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331536 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-var-lib-openvswitch\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-env-overrides\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzn2s\" (UniqueName: \"kubernetes.io/projected/7f59943a-5b9e-42e5-95af-df6d051b0988-kube-api-access-dzn2s\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-cni-bin\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-lib-modules\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-cni-netd\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98h7b\" (UniqueName: \"kubernetes.io/projected/75e44a91-97d0-4697-86f9-d018aa5972d5-kube-api-access-98h7b\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-sys\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f59943a-5b9e-42e5-95af-df6d051b0988-ovn-node-metrics-cert\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-node-log\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-log-socket\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75e44a91-97d0-4697-86f9-d018aa5972d5-host\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.331897 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-kubernetes\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-kubelet\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-env-overrides\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333259 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.331963 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:13.831946871 +0000 UTC m=+3.154681965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-sys\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-host-kubelet\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-ovn\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-node-log\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75e44a91-97d0-4697-86f9-d018aa5972d5-host\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-run-ovn\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.331961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f59943a-5b9e-42e5-95af-df6d051b0988-log-socket\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332155 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f864901-7655-450f-9327-29029e38b5da-etc-kubernetes\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332217 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/93695682-9372-498e-8bdb-bdfee90418b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1501e80c-7f30-459c-b9c4-d5344e0364fa-iptables-alerter-script\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.332639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f59943a-5b9e-42e5-95af-df6d051b0988-ovnkube-config\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.333035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f864901-7655-450f-9327-29029e38b5da-etc-tuned\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.333780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.333587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f864901-7655-450f-9327-29029e38b5da-tmp\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.334171 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.333967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f59943a-5b9e-42e5-95af-df6d051b0988-ovn-node-metrics-cert\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.338789 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.338727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwndq\" (UniqueName: \"kubernetes.io/projected/7f864901-7655-450f-9327-29029e38b5da-kube-api-access-wwndq\") pod \"tuned-8nfpx\" (UID: \"7f864901-7655-450f-9327-29029e38b5da\") " pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.338881 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.338790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj9rb\" (UniqueName: \"kubernetes.io/projected/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-kube-api-access-nj9rb\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.338881 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.338811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khg56\" (UniqueName: \"kubernetes.io/projected/93695682-9372-498e-8bdb-bdfee90418b9-kube-api-access-khg56\") pod \"aws-ebs-csi-driver-node-6nd9j\" (UID: \"93695682-9372-498e-8bdb-bdfee90418b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.340715 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.340693 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:13.340715 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.340719 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:13.340883 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.340732 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:13.340883 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.340802 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:13.840786491 +0000 UTC m=+3.163521578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:13.341947 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.341901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" event={"ID":"e0ed51d9364ae62e3a06389f9323db96","Type":"ContainerStarted","Data":"5134ebba3aed966fc6087fc2e63c61c1c7f836a3417f4f91f356a3eec13c4b47"} Jul 06 19:05:13.342072 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.341975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98h7b\" (UniqueName: \"kubernetes.io/projected/75e44a91-97d0-4697-86f9-d018aa5972d5-kube-api-access-98h7b\") pod \"node-ca-lxg4q\" (UID: \"75e44a91-97d0-4697-86f9-d018aa5972d5\") " pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.342434 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.342411 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzn2s\" (UniqueName: \"kubernetes.io/projected/7f59943a-5b9e-42e5-95af-df6d051b0988-kube-api-access-dzn2s\") pod \"ovnkube-node-jjxq8\" (UID: \"7f59943a-5b9e-42e5-95af-df6d051b0988\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.342811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.342786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgzx\" (UniqueName: \"kubernetes.io/projected/1501e80c-7f30-459c-b9c4-d5344e0364fa-kube-api-access-kbgzx\") pod \"iptables-alerter-5sncc\" (UID: \"1501e80c-7f30-459c-b9c4-d5344e0364fa\") " pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.343051 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.343024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" event={"ID":"3cf9d28c09d100896579d38a5deeb770","Type":"ContainerStarted","Data":"a47b16a759b3e7afb56b1d43727d8340c60c22549c7aefd27d56941163cd6b59"} Jul 06 19:05:13.409984 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.409953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:13.415814 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.415786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4xg6g" Jul 06 19:05:13.419477 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.419445 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb46a76a_5cba_483c_9567_d1a84ed73e5a.slice/crio-ce7add7f47d07a86e695af6d9a1590a34941999d59321f6cac23287af2579818 WatchSource:0}: Error finding container ce7add7f47d07a86e695af6d9a1590a34941999d59321f6cac23287af2579818: Status 404 returned error can't find the container with id ce7add7f47d07a86e695af6d9a1590a34941999d59321f6cac23287af2579818 Jul 06 19:05:13.424375 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.424352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cr9z" Jul 06 19:05:13.425907 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.425880 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda669b24a_1165_42d2_b60f_8bc7255f85b9.slice/crio-0a79f8aec2886bde8f4eaeb6aaf9c422e07c494aaafd50d209372d9538cb6730 WatchSource:0}: Error finding container 0a79f8aec2886bde8f4eaeb6aaf9c422e07c494aaafd50d209372d9538cb6730: Status 404 returned error can't find the container with id 0a79f8aec2886bde8f4eaeb6aaf9c422e07c494aaafd50d209372d9538cb6730 Jul 06 19:05:13.427963 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.427943 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" Jul 06 19:05:13.434625 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.434604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lxg4q" Jul 06 19:05:13.437502 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.437479 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a461fdf_115d_46c3_8bde_d9bc2e953182.slice/crio-4fcdcf9427106ff73fbc67cfb21e1489971a4c3b86f6eadcae4405de02f4feb6 WatchSource:0}: Error finding container 4fcdcf9427106ff73fbc67cfb21e1489971a4c3b86f6eadcae4405de02f4feb6: Status 404 returned error can't find the container with id 4fcdcf9427106ff73fbc67cfb21e1489971a4c3b86f6eadcae4405de02f4feb6 Jul 06 19:05:13.439318 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.439160 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" Jul 06 19:05:13.446124 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.444961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" Jul 06 19:05:13.449628 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.449597 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e44a91_97d0_4697_86f9_d018aa5972d5.slice/crio-eb9352de49bc89bf0b5d6bf0d41e88a833195c5f7dd5e78d7913caef97009c2d WatchSource:0}: Error finding container eb9352de49bc89bf0b5d6bf0d41e88a833195c5f7dd5e78d7913caef97009c2d: Status 404 returned error can't find the container with id eb9352de49bc89bf0b5d6bf0d41e88a833195c5f7dd5e78d7913caef97009c2d Jul 06 19:05:13.450595 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.450348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5sncc" Jul 06 19:05:13.451541 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.451492 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93695682_9372_498e_8bdb_bdfee90418b9.slice/crio-92c5294887813f13e6c507be1174dea055120ff0e29fdf0056cfb4f99aa09c5a WatchSource:0}: Error finding container 92c5294887813f13e6c507be1174dea055120ff0e29fdf0056cfb4f99aa09c5a: Status 404 returned error can't find the container with id 92c5294887813f13e6c507be1174dea055120ff0e29fdf0056cfb4f99aa09c5a Jul 06 19:05:13.455271 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.455255 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:13.459552 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.459521 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f864901_7655_450f_9327_29029e38b5da.slice/crio-22719b3a87651e3d2fe01c7dcc55b4bc4233975a34b3ef6acde0cd0988d20915 WatchSource:0}: Error finding container 22719b3a87651e3d2fe01c7dcc55b4bc4233975a34b3ef6acde0cd0988d20915: Status 404 returned error can't find the container with id 22719b3a87651e3d2fe01c7dcc55b4bc4233975a34b3ef6acde0cd0988d20915 Jul 06 19:05:13.465566 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.465542 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1501e80c_7f30_459c_b9c4_d5344e0364fa.slice/crio-cfbfced59cd5e79b540f128bc059d5381ef85a5901d85b7f690335e6c0887f8b WatchSource:0}: Error finding container cfbfced59cd5e79b540f128bc059d5381ef85a5901d85b7f690335e6c0887f8b: Status 404 returned error can't find the container with id cfbfced59cd5e79b540f128bc059d5381ef85a5901d85b7f690335e6c0887f8b Jul 06 19:05:13.468629 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:13.468503 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f59943a_5b9e_42e5_95af_df6d051b0988.slice/crio-54f22981b6eeff8245094df6498250256d3180b25ccb7307ff36020bca7b5032 WatchSource:0}: Error finding container 54f22981b6eeff8245094df6498250256d3180b25ccb7307ff36020bca7b5032: Status 404 returned error can't find the container with id 54f22981b6eeff8245094df6498250256d3180b25ccb7307ff36020bca7b5032 Jul 06 19:05:13.516579 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.516394 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:13.736610 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.736529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:13.736770 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.736706 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:13.736825 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.736772 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:14.736754207 +0000 UTC m=+4.059489297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:13.837067 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.837031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:13.837259 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.837182 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:13.837259 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.837254 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:14.837236601 +0000 UTC m=+4.159971687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:13.938538 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:13.938500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:13.938715 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.938696 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:13.938787 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.938722 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:13.938787 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.938733 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:13.938875 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:13.938789 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:14.938770559 +0000 UTC m=+4.261505631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:14.160024 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.159919 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:13 +0000 UTC" deadline="2028-04-09 13:45:20.619855928 +0000 UTC" Jul 06 19:05:14.160024 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.159954 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15426h40m6.459906856s" Jul 06 19:05:14.337491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.337459 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:14.337678 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.337473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:14.337678 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.337592 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:14.337795 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.337725 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:14.350243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.350152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5sncc" event={"ID":"1501e80c-7f30-459c-b9c4-d5344e0364fa","Type":"ContainerStarted","Data":"cfbfced59cd5e79b540f128bc059d5381ef85a5901d85b7f690335e6c0887f8b"} Jul 06 19:05:14.351563 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.351531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xg6g" event={"ID":"a669b24a-1165-42d2-b60f-8bc7255f85b9","Type":"ContainerStarted","Data":"0a79f8aec2886bde8f4eaeb6aaf9c422e07c494aaafd50d209372d9538cb6730"} Jul 06 19:05:14.357000 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.356972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wcmdx" event={"ID":"eb46a76a-5cba-483c-9567-d1a84ed73e5a","Type":"ContainerStarted","Data":"ce7add7f47d07a86e695af6d9a1590a34941999d59321f6cac23287af2579818"} Jul 06 19:05:14.358185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.358162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" event={"ID":"7f864901-7655-450f-9327-29029e38b5da","Type":"ContainerStarted","Data":"22719b3a87651e3d2fe01c7dcc55b4bc4233975a34b3ef6acde0cd0988d20915"} Jul 06 19:05:14.359364 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.359340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" event={"ID":"93695682-9372-498e-8bdb-bdfee90418b9","Type":"ContainerStarted","Data":"92c5294887813f13e6c507be1174dea055120ff0e29fdf0056cfb4f99aa09c5a"} Jul 06 19:05:14.360583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.360549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lxg4q" event={"ID":"75e44a91-97d0-4697-86f9-d018aa5972d5","Type":"ContainerStarted","Data":"eb9352de49bc89bf0b5d6bf0d41e88a833195c5f7dd5e78d7913caef97009c2d"} Jul 06 19:05:14.362003 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.361980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerStarted","Data":"cc45d610a7be96dab6d0b43b3ffc84d7028925d5445579b7c773f783d8d64e96"} Jul 06 19:05:14.363250 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.363228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cr9z" event={"ID":"1a461fdf-115d-46c3-8bde-d9bc2e953182","Type":"ContainerStarted","Data":"4fcdcf9427106ff73fbc67cfb21e1489971a4c3b86f6eadcae4405de02f4feb6"} Jul 06 19:05:14.364564 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.364486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"54f22981b6eeff8245094df6498250256d3180b25ccb7307ff36020bca7b5032"} Jul 06 19:05:14.745462 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.745425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:14.745677 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.745654 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:14.745762 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.745730 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:16.745709933 +0000 UTC m=+6.068445027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:14.846417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.846379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:14.846599 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.846523 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:14.846599 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.846595 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:16.846576808 +0000 UTC m=+6.169311884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:14.947128 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:14.947072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:14.947337 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.947319 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:14.947402 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.947345 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:14.947402 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.947361 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:14.947503 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:14.947427 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:16.947408212 +0000 UTC m=+6.270143300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:15.160713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:15.160573 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:13 +0000 UTC" deadline="2028-02-27 19:19:48.57047343 +0000 UTC" Jul 06 19:05:15.160713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:15.160632 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14424h14m33.409845198s" Jul 06 19:05:15.338189 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:15.338158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:15.338365 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:15.338307 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:16.337029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:16.336998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:16.337503 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.337134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:16.337669 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:16.337652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:16.337756 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.337738 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:16.760060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:16.759959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:16.760242 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.760172 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:16.760302 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.760250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:20.760228925 +0000 UTC m=+10.082963998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:16.860820 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:16.860786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:16.860997 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.860924 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:16.860997 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.860988 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:20.860970321 +0000 UTC m=+10.183705407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:16.961150 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:16.961112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:16.961327 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.961315 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:16.961382 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.961332 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:16.961382 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.961345 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:16.961477 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:16.961400 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:20.961382595 +0000 UTC m=+10.284117668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:17.339185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:17.339151 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:17.339666 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:17.339302 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:18.337640 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:18.337606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:18.337811 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:18.337738 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:18.338263 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:18.338118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:18.338263 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:18.338220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:19.337915 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:19.337884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:19.338325 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:19.338049 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:20.337076 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:20.337044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:20.337263 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.337191 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:20.337331 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:20.337051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:20.337416 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.337390 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:20.793048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:20.793008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:20.793508 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.793209 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:20.793508 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.793287 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.793264585 +0000 UTC m=+18.115999660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:20.893560 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:20.893528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:20.893722 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.893701 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:20.893797 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.893761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.893742369 +0000 UTC m=+18.216477457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:20.994603 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:20.994572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:20.994762 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.994686 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:20.994762 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.994701 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:20.994762 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.994710 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:20.994878 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:20.994764 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.994749804 +0000 UTC m=+18.317484876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:21.338683 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:21.338329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:21.338683 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:21.338458 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:22.337227 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:22.337196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:22.337665 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:22.337198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:22.337665 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:22.337298 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:22.337665 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:22.337380 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:23.337257 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:23.337210 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:23.337649 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:23.337348 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:24.337972 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.337690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:24.338435 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:24.338025 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:24.338435 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.337693 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:24.338435 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:24.338193 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:24.386308 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.386068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4xg6g" event={"ID":"a669b24a-1165-42d2-b60f-8bc7255f85b9","Type":"ContainerStarted","Data":"aed25e5168dd2e29404bdecc225e811dd20ec649eb5c3a02cf9863a3e3055502"} Jul 06 19:05:24.387997 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.387970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wcmdx" event={"ID":"eb46a76a-5cba-483c-9567-d1a84ed73e5a","Type":"ContainerStarted","Data":"04d1be92b7cfe369dc0b64b81c446cfd2d1b9ea9d8a72a4eb3a42a2db4db3727"} Jul 06 19:05:24.389930 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.389905 2577 generic.go:356] "Generic (PLEG): container finished" podID="e0ed51d9364ae62e3a06389f9323db96" containerID="fadd245f4e54cc2501d13637f51854f13d0ac5e74b1fcebfdf07382c4c6e2e57" exitCode=0 Jul 06 19:05:24.390019 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.389989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" event={"ID":"e0ed51d9364ae62e3a06389f9323db96","Type":"ContainerDied","Data":"fadd245f4e54cc2501d13637f51854f13d0ac5e74b1fcebfdf07382c4c6e2e57"} Jul 06 19:05:24.392288 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.391916 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" event={"ID":"3cf9d28c09d100896579d38a5deeb770","Type":"ContainerStarted","Data":"67e85ecfc1cd9d0644151bdca764184901653466f17f98520cbd73984bc74051"} Jul 06 19:05:24.393941 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.393898 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" event={"ID":"7f864901-7655-450f-9327-29029e38b5da","Type":"ContainerStarted","Data":"603cab448aae06f1158d2fce8d916fd5f62705f814a84420ff5c1095b7a3c1a1"} Jul 06 19:05:24.395717 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.395695 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" event={"ID":"93695682-9372-498e-8bdb-bdfee90418b9","Type":"ContainerStarted","Data":"88b499e49a3b7eb1f98e0ffd54053fe4e106277a4e1fe58015ef3c62a1d71ad3"} Jul 06 19:05:24.397504 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.397479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lxg4q" event={"ID":"75e44a91-97d0-4697-86f9-d018aa5972d5","Type":"ContainerStarted","Data":"2bb3fbfd0944c65f771abc6d3bce6ca741b18912b1662ad13660331484b46606"} Jul 06 19:05:24.399425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.399403 2577 generic.go:356] "Generic (PLEG): container finished" podID="e21d6797-d239-4c0c-9446-0603259981b4" containerID="d2722d79f8bad56cf76c2fe0c03b9cb73f5d73ea54b3e6efd1a5b16fec0a5d51" exitCode=0 Jul 06 19:05:24.399499 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.399437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerDied","Data":"d2722d79f8bad56cf76c2fe0c03b9cb73f5d73ea54b3e6efd1a5b16fec0a5d51"} Jul 06 19:05:24.407188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.407145 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4xg6g" podStartSLOduration=3.417556692 podStartE2EDuration="13.407131501s" totalImagesPullingTime="9.989574809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:24.40577731 +0000 UTC m=+13.728512406" watchObservedRunningTime="2026-07-06 19:05:24.407131501 +0000 UTC m=+13.729866596" Jul 06 19:05:24.423002 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.422960 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-12.ec2.internal" podStartSLOduration=12.422943873 podStartE2EDuration="12.422943873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:24.422211677 +0000 UTC m=+13.744946772" watchObservedRunningTime="2026-07-06 19:05:24.422943873 +0000 UTC m=+13.745678968" Jul 06 19:05:24.452637 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.452587 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wcmdx" podStartSLOduration=3.4575249 podStartE2EDuration="13.452569893s" totalImagesPullingTime="9.995044993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:24.452211476 +0000 UTC m=+13.774946570" watchObservedRunningTime="2026-07-06 19:05:24.452569893 +0000 UTC m=+13.775304987" Jul 06 19:05:24.490365 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:24.490327 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lxg4q" podStartSLOduration=3.526741312 podStartE2EDuration="13.490315692s" totalImagesPullingTime="9.96357438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:24.490067076 +0000 UTC m=+13.812802171" watchObservedRunningTime="2026-07-06 19:05:24.490315692 +0000 UTC m=+13.813051129" Jul 06 19:05:25.337683 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:25.337656 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:25.337843 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:25.337792 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:25.403359 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:25.403329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" event={"ID":"e0ed51d9364ae62e3a06389f9323db96","Type":"ContainerStarted","Data":"9359201165bc7b1e4717d6aa1d06f8e3ab8f02b45364fcdb0852aee0c9e25a83"} Jul 06 19:05:25.405707 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:25.405678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5sncc" event={"ID":"1501e80c-7f30-459c-b9c4-d5344e0364fa","Type":"ContainerStarted","Data":"940f4c1f654c244342a0aade9d90fc4098067aaa2b8dab44beb704bcf2c81a18"} Jul 06 19:05:25.418379 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:25.418338 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8nfpx" podStartSLOduration=4.385326561 podStartE2EDuration="14.418320282s" totalImagesPullingTime="10.032993721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:24.511244849 +0000 UTC m=+13.833979944" watchObservedRunningTime="2026-07-06 19:05:25.418320282 +0000 UTC m=+14.741055377" Jul 06 19:05:25.418783 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:25.418753 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-12.ec2.internal" podStartSLOduration=13.418747191 podStartE2EDuration="13.418747191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:25.418295712 +0000 UTC m=+14.741030808" watchObservedRunningTime="2026-07-06 19:05:25.418747191 +0000 UTC m=+14.741482286" Jul 06 19:05:25.432389 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:25.432349 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5sncc" podStartSLOduration=4.474351272 podStartE2EDuration="14.432335793s" totalImagesPullingTime="9.957984521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:25.432329379 +0000 UTC m=+14.755064472" watchObservedRunningTime="2026-07-06 19:05:25.432335793 +0000 UTC m=+14.755070886" Jul 06 19:05:26.338912 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:26.337645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:26.338912 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:26.338020 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:26.338912 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:26.338522 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:26.338912 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:26.338637 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:27.337164 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:27.337129 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:27.337643 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:27.337266 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:28.337037 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:28.337007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:28.337259 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:28.337140 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:28.337259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:28.337198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:28.337725 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:28.337306 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:28.828664 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:28.828535 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:28.829251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:28.829194 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:28.855058 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:28.855030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:28.855189 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:28.855171 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:28.855250 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:28.855238 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:44.855218209 +0000 UTC m=+34.177953284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:28.956460 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:28.956343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:28.956674 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:28.956652 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:28.956759 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:28.956719 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:44.956699717 +0000 UTC m=+34.279434788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:29.057120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:29.057092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:29.057257 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:29.057241 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:29.057314 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:29.057262 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:29.057314 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:29.057270 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:29.057314 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:29.057312 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.057299975 +0000 UTC m=+34.380035047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:29.336935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:29.336906 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:29.337114 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:29.337054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:30.337712 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:30.337681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:30.338222 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:30.337681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:30.338222 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:30.337819 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:30.338222 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:30.337881 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:31.338739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:31.338704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:31.339286 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:31.338828 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:31.607770 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:31.607687 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:31.607907 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:31.607806 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:05:31.608292 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:31.608211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wcmdx" Jul 06 19:05:32.337470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:32.337442 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:32.337638 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:32.337558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:32.337638 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:32.337618 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:32.337725 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:32.337708 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:33.337276 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:33.337247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:33.337644 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:33.337354 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:33.579506 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:33.579343 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:05:34.263003 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.262854 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:05:33.579502128Z","UUID":"6bea08a2-2168-4b97-8b33-11acac25d78b","Handler":null,"Name":"","Endpoint":""} Jul 06 19:05:34.264694 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.264669 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:05:34.264838 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.264714 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:05:34.337822 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.337792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:34.338395 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:34.337913 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:34.338395 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.337963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:34.338395 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:34.338098 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:34.424361 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.424326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cr9z" event={"ID":"1a461fdf-115d-46c3-8bde-d9bc2e953182","Type":"ContainerStarted","Data":"b9e712470a2e4f26d157703da94441b7bf684ee8ea717524b5778613f2b31a1b"} Jul 06 19:05:34.426407 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.426383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" event={"ID":"93695682-9372-498e-8bdb-bdfee90418b9","Type":"ContainerStarted","Data":"383f05b7c9e7c9a99ed6fe93f9fa875c0d1e497a76b78b02ce90fdc77f1e22a3"} Jul 06 19:05:34.440911 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:34.440868 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2cr9z" podStartSLOduration=3.427893429 podStartE2EDuration="23.440852391s" totalImagesPullingTime="20.012958962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:34.440556424 +0000 UTC m=+23.763291522" watchObservedRunningTime="2026-07-06 19:05:34.440852391 +0000 UTC m=+23.763587486" Jul 06 19:05:35.337530 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:35.337506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:35.337683 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:35.337640 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:35.429377 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:35.429321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"c7a5674c026533a3e3c930b373ab96a341c85edf6f18de252736a70d2fc76d11"} Jul 06 19:05:35.429656 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:35.429390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"43d36c56692ad57e6a38dee5180be3736fb98be225cb2021de0cf3f9bef1afd6"} Jul 06 19:05:36.337471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.337297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:36.337624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.337297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:36.337624 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:36.337558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:36.337691 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:36.337655 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:36.434623 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.434596 2577 generic.go:356] "Generic (PLEG): container finished" podID="e21d6797-d239-4c0c-9446-0603259981b4" containerID="d5416e76b05d2d6e46be79b8bd64ba99a3748a17e83590011137e8f78920e354" exitCode=0 Jul 06 19:05:36.435000 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.434697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerDied","Data":"d5416e76b05d2d6e46be79b8bd64ba99a3748a17e83590011137e8f78920e354"} Jul 06 19:05:36.438076 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:05:36.438619 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438427 2577 generic.go:356] "Generic (PLEG): container finished" podID="7f59943a-5b9e-42e5-95af-df6d051b0988" containerID="c7a5674c026533a3e3c930b373ab96a341c85edf6f18de252736a70d2fc76d11" exitCode=1 Jul 06 19:05:36.438619 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerDied","Data":"c7a5674c026533a3e3c930b373ab96a341c85edf6f18de252736a70d2fc76d11"} Jul 06 19:05:36.438619 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"cd4ad5b4ba49002245d0c9590e7462b4c2b1612a3bc17997008fd5e0f146de5f"} Jul 06 19:05:36.438619 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438598 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"0ba0aeed997b1f064f48c2576c2283dd34adccfa2e4e0b71ee937e0e7edf39cb"} Jul 06 19:05:36.438853 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438636 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"a49c9819e993ef523863920e3c5df257e309b54c55ff8b5e6f9cd74700df8451"} Jul 06 19:05:36.438853 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:36.438676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"0a3c50dce39f69f381df9dff279f0eeaa0bab61e8c706579e677300e5996e036"} Jul 06 19:05:37.337196 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:37.337161 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:37.337427 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:37.337274 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:37.443072 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:37.443040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" event={"ID":"93695682-9372-498e-8bdb-bdfee90418b9","Type":"ContainerStarted","Data":"8e4b7397f854ab9ae16c87e70ef235d3682a9fb3d1f8d6de6f254640ad92e34e"} Jul 06 19:05:37.461137 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:37.461075 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nd9j" podStartSLOduration=4.100428738 podStartE2EDuration="26.461060387s" totalImagesPullingTime="22.360631649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:37.460688019 +0000 UTC m=+26.783423113" watchObservedRunningTime="2026-07-06 19:05:37.461060387 +0000 UTC m=+26.783795481" Jul 06 19:05:38.337870 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:38.337839 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:38.338038 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:38.337879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:38.338038 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:38.337949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:38.338147 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:38.338032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:38.447351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:38.447324 2577 generic.go:356] "Generic (PLEG): container finished" podID="e21d6797-d239-4c0c-9446-0603259981b4" containerID="fab2c10d3fa42c4260f075e55c6a9b863684725898b4f6ef49840cc597f1484c" exitCode=0 Jul 06 19:05:38.447750 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:38.447357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerDied","Data":"fab2c10d3fa42c4260f075e55c6a9b863684725898b4f6ef49840cc597f1484c"} Jul 06 19:05:38.450601 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:38.450586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:05:38.451014 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:38.450964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"465ee3a430581aff019d84a8daf4a72c89a76655d13e873d9410946f7e3e8dbb"} Jul 06 19:05:39.337421 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:39.337378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:39.337596 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:39.337560 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:40.337246 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.337009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:40.337720 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.337009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:40.337720 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:40.337263 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:40.337720 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:40.337328 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:40.457984 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.457953 2577 generic.go:356] "Generic (PLEG): container finished" podID="e21d6797-d239-4c0c-9446-0603259981b4" containerID="2c04d33fc5b45ece9e6d7ec0c97be4e350ce606768e1d48c588bb9baf7ad3fe9" exitCode=0 Jul 06 19:05:40.458145 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.458029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerDied","Data":"2c04d33fc5b45ece9e6d7ec0c97be4e350ce606768e1d48c588bb9baf7ad3fe9"} Jul 06 19:05:40.461624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.461595 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:05:40.461961 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.461941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"3e0ff3e0e5dd09e0df8c5e77c0a236e9eac3aa3c84286bd0e40c5646faefa70f"} Jul 06 19:05:40.462208 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.462186 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:40.462292 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.462256 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:40.462423 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.462412 2577 scope.go:117] "RemoveContainer" containerID="c7a5674c026533a3e3c930b373ab96a341c85edf6f18de252736a70d2fc76d11" Jul 06 19:05:40.478742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:40.478722 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:41.338157 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:41.338121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:41.338592 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:41.338241 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:41.469157 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:41.469125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:05:41.469588 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:41.469560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" event={"ID":"7f59943a-5b9e-42e5-95af-df6d051b0988","Type":"ContainerStarted","Data":"fa4a04c1aa22a349bdd6806ed91c5860398c2fc5f299fa8566e57e4f2589336f"} Jul 06 19:05:41.469771 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:41.469753 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:41.486459 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:41.486431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:05:41.561927 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:41.561879 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" podStartSLOduration=8.876251392 podStartE2EDuration="30.561865897s" totalImagesPullingTime="21.685614505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:41.514022939 +0000 UTC m=+30.836758033" watchObservedRunningTime="2026-07-06 19:05:41.561865897 +0000 UTC m=+30.884600990" Jul 06 19:05:42.161509 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:42.161476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kj9q9"] Jul 06 19:05:42.161702 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:42.161646 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:42.161788 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:42.161765 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:42.164700 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:42.164375 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7l5n8"] Jul 06 19:05:42.164700 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:42.164491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:42.164700 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:42.164629 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:42.165229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:42.165203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqgc5"] Jul 06 19:05:42.165345 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:42.165312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:42.165419 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:42.165392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:44.337347 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:44.337278 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:44.337649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:44.337289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:44.337649 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.337392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:44.337649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:44.337405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:44.337649 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.337467 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:44.337649 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.337534 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:44.873554 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:44.873532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:44.873705 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.873687 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:44.873768 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.873761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret podName:a1b22251-5299-42cf-9373-759be5b5ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:06:16.87373982 +0000 UTC m=+66.196474909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret") pod "global-pull-secret-syncer-7l5n8" (UID: "a1b22251-5299-42cf-9373-759be5b5ae9c") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:44.974043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:44.973984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:44.974152 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.974130 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:44.974212 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:44.974188 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs podName:92b23d0b-3347-4b1b-9af2-650ff6fd6c04 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:16.974169683 +0000 UTC m=+66.296904764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs") pod "network-metrics-daemon-kj9q9" (UID: "92b23d0b-3347-4b1b-9af2-650ff6fd6c04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:45.074534 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:45.074514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:45.074636 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:45.074625 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:45.074636 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:45.074636 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:45.074716 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:45.074645 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mqf7h for pod openshift-network-diagnostics/network-check-target-vqgc5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:45.074716 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:45.074683 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h podName:e30d0c8a-d5a3-4227-a519-e07f6b2c2292 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:17.074671753 +0000 UTC m=+66.397406826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqf7h" (UniqueName: "kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h") pod "network-check-target-vqgc5" (UID: "e30d0c8a-d5a3-4227-a519-e07f6b2c2292") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:46.337667 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:46.337585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:46.338129 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:46.337694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:46.338129 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:46.337702 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqgc5" podUID="e30d0c8a-d5a3-4227-a519-e07f6b2c2292" Jul 06 19:05:46.338129 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:46.337726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:46.338129 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:46.337841 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7l5n8" podUID="a1b22251-5299-42cf-9373-759be5b5ae9c" Jul 06 19:05:46.338129 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:46.337938 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj9q9" podUID="92b23d0b-3347-4b1b-9af2-650ff6fd6c04" Jul 06 19:05:47.488037 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.487859 2577 generic.go:356] "Generic (PLEG): container finished" podID="e21d6797-d239-4c0c-9446-0603259981b4" containerID="6f3d5f7bd947e7cd7c05bf7e5542e4dd7c77acdd69b6506e26cd440756e53a1e" exitCode=0 Jul 06 19:05:47.488488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.487939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerDied","Data":"6f3d5f7bd947e7cd7c05bf7e5542e4dd7c77acdd69b6506e26cd440756e53a1e"} Jul 06 19:05:47.906311 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.906279 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-12.ec2.internal" event="NodeReady" Jul 06 19:05:47.906475 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.906394 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:05:47.945534 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.945498 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78b89df946-bxpkn"] Jul 06 19:05:47.948728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.948714 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:47.951491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.951468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:05:47.951491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.951492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:05:47.951703 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.951494 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:05:47.951703 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.951624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dj2cn\"" Jul 06 19:05:47.959118 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.959076 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:05:47.962726 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.962706 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b89df946-bxpkn"] Jul 06 19:05:47.967102 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.967054 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh"] Jul 06 19:05:47.969781 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.969762 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg"] Jul 06 19:05:47.969899 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.969884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" Jul 06 19:05:47.972523 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.972506 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s"] Jul 06 19:05:47.972647 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.972632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:47.973472 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.973456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wjrkr\"" Jul 06 19:05:47.973799 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.973782 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:47.974148 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.974132 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.975729 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.975713 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b"] Jul 06 19:05:47.975897 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.975881 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:05:47.975970 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.975918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:47.977475 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.977455 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 19:05:47.977475 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.977465 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fsqd5\"" Jul 06 19:05:47.977615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.977478 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.977615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.977522 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 19:05:47.978070 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.978053 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4"] Jul 06 19:05:47.978192 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.978176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:47.978562 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.978457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 19:05:47.978758 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.978744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:47.978935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.978921 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 19:05:47.979001 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.978988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.979737 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.979725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c7pvh\"" Jul 06 19:05:47.980246 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.980227 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4zrmx"] Jul 06 19:05:47.980343 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.980328 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:47.982062 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.982039 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:47.982593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.982123 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:05:47.982593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.982132 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5mrcr\"" Jul 06 19:05:47.982593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.982125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:05:47.982593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.982376 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.984208 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.984190 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f65c66c8f-qrlzn"] Jul 06 19:05:47.984607 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.984587 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hk4nz\"" Jul 06 19:05:47.984962 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.984940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.985455 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.985432 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:47.985634 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.984971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:47.985745 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.985617 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:05:47.988235 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.988219 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.989530 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.989380 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:47.989530 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.989522 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-t8kjl"] Jul 06 19:05:47.989695 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.989613 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:05:47.989924 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.989791 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:05:47.989924 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.989892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:47.990566 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.990547 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d62b7\"" Jul 06 19:05:47.993682 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993652 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh"] Jul 06 19:05:47.993781 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993717 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s"] Jul 06 19:05:47.993781 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993744 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg"] Jul 06 19:05:47.993883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4"] Jul 06 19:05:47.993883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993817 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4zrmx"] Jul 06 19:05:47.993883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993869 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b"] Jul 06 19:05:47.994030 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.993894 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl"] Jul 06 19:05:47.995575 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.995197 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:05:47.995575 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.995300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:05:47.995575 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.995535 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:05:47.999661 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.997003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:47.999661 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.997368 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:05:47.999661 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.997666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:05:47.999661 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.997028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lnzhx\"" Jul 06 19:05:47.999661 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:47.999143 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:05:48.001800 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.001779 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:05:48.002108 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.002074 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:05:48.002347 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.002312 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-svb5p\"" Jul 06 19:05:48.002667 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.002633 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:05:48.003791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.003209 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wps7n"] Jul 06 19:05:48.004020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.003986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.004612 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.004591 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:05:48.004832 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.004812 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:05:48.008443 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.008178 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qw8z8"] Jul 06 19:05:48.008687 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.008669 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 19:05:48.008989 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.008971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.010379 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.010359 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4w4sn\"" Jul 06 19:05:48.010543 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.010524 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 19:05:48.011626 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.011607 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:05:48.011991 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.011970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:05:48.012437 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.012407 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:05:48.012542 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.012525 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:05:48.012794 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.012777 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6qj8k\"" Jul 06 19:05:48.012978 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.012960 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n"] Jul 06 19:05:48.013101 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.013062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.015613 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.015595 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:05:48.015798 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.015785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:05:48.016070 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016056 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mb8mb\"" Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016698 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-t8kjl"] Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f65c66c8f-qrlzn"] Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl"] Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n"] Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016808 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wps7n"] Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016827 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qw8z8"] Jul 06 19:05:48.017105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.016919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" Jul 06 19:05:48.019742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.019725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:05:48.019866 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.019786 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:05:48.019954 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.019797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zlkzj\"" Jul 06 19:05:48.095325 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d56bb270-2e88-4e18-8586-6232d36fcb69-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.095433 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392-cert\") pod \"ingress-canary-wps7n\" (UID: \"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392\") " pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.095433 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-ca-trust-extracted\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.095433 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px64d\" (UniqueName: \"kubernetes.io/projected/8347f51f-8584-4298-9ca9-c34545507611-kube-api-access-px64d\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.095433 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7g2x\" (UniqueName: \"kubernetes.io/projected/d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392-kube-api-access-b7g2x\") pod \"ingress-canary-wps7n\" (UID: \"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392\") " pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.095562 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.095562 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977afa96-c2d6-4d9f-91aa-25bcba2a898a-serving-cert\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.095624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb2ff725-e976-42e1-ac97-c0b0d150e281-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.095624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-image-registry-private-configuration\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.095680 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65djw\" (UniqueName: \"kubernetes.io/projected/977afa96-c2d6-4d9f-91aa-25bcba2a898a-kube-api-access-65djw\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.095680 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fzkc\" (UniqueName: \"kubernetes.io/projected/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-kube-api-access-5fzkc\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.095680 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.095778 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d328db8-9434-4028-b5be-112a19959976-trusted-ca\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.095778 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.095778 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4cv8\" (UniqueName: \"kubernetes.io/projected/eb2ff725-e976-42e1-ac97-c0b0d150e281-kube-api-access-m4cv8\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.095778 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-installation-pull-secrets\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.095923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.095923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-config\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.095923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-trusted-ca\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.095923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb2ff725-e976-42e1-ac97-c0b0d150e281-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.095923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977afa96-c2d6-4d9f-91aa-25bcba2a898a-snapshots\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.095923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-certificates\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.095945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28tbc\" (UniqueName: \"kubernetes.io/projected/ccf23230-2365-41e2-b5e4-d8c093fdf575-kube-api-access-28tbc\") pod \"volume-data-source-validator-5d456fdbcd-j85zh\" (UID: \"ccf23230-2365-41e2-b5e4-d8c093fdf575\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-default-certificate\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-stats-auth\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d328db8-9434-4028-b5be-112a19959976-config\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-bound-sa-token\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4nh\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-kube-api-access-2k4nh\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.096221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977afa96-c2d6-4d9f-91aa-25bcba2a898a-tmp\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08675e57-5f60-4adc-9155-69928a3bc98f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kff6d\" (UniqueName: \"kubernetes.io/projected/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-kube-api-access-kff6d\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mmn\" (UniqueName: \"kubernetes.io/projected/4d328db8-9434-4028-b5be-112a19959976-kube-api-access-t9mmn\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977afa96-c2d6-4d9f-91aa-25bcba2a898a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8785l\" (UniqueName: \"kubernetes.io/projected/d56bb270-2e88-4e18-8586-6232d36fcb69-kube-api-access-8785l\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d328db8-9434-4028-b5be-112a19959976-serving-cert\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.096491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.096419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977afa96-c2d6-4d9f-91aa-25bcba2a898a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.197743 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28tbc\" (UniqueName: \"kubernetes.io/projected/ccf23230-2365-41e2-b5e4-d8c093fdf575-kube-api-access-28tbc\") pod \"volume-data-source-validator-5d456fdbcd-j85zh\" (UID: \"ccf23230-2365-41e2-b5e4-d8c093fdf575\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" Jul 06 19:05:48.197896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-default-certificate\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.197896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-stats-auth\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.197896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d328db8-9434-4028-b5be-112a19959976-config\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.197896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.197896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-bound-sa-token\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.197896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4nh\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-kube-api-access-2k4nh\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.198251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977afa96-c2d6-4d9f-91aa-25bcba2a898a-tmp\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.198251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08675e57-5f60-4adc-9155-69928a3bc98f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.198251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:48.198251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.197995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.198251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kff6d\" (UniqueName: \"kubernetes.io/projected/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-kube-api-access-kff6d\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198511 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198544 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198585 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls podName:cd4c20ba-44ae-4a4e-a0ed-58d744237c38 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.698566167 +0000 UTC m=+38.021301251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lcbh4" (UID: "cd4c20ba-44ae-4a4e-a0ed-58d744237c38") : secret "samples-operator-tls" not found Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mmn\" (UniqueName: \"kubernetes.io/projected/4d328db8-9434-4028-b5be-112a19959976-kube-api-access-t9mmn\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977afa96-c2d6-4d9f-91aa-25bcba2a898a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8785l\" (UniqueName: \"kubernetes.io/projected/d56bb270-2e88-4e18-8586-6232d36fcb69-kube-api-access-8785l\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d328db8-9434-4028-b5be-112a19959976-serving-cert\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977afa96-c2d6-4d9f-91aa-25bcba2a898a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d56bb270-2e88-4e18-8586-6232d36fcb69-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392-cert\") pod \"ingress-canary-wps7n\" (UID: \"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392\") " pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198830 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-ca-trust-extracted\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198843 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b89df946-bxpkn: secret "image-registry-tls" not found Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px64d\" (UniqueName: \"kubernetes.io/projected/8347f51f-8584-4298-9ca9-c34545507611-kube-api-access-px64d\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198882 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls podName:ddf63e1d-d4b5-4e11-89e4-949abc9b17bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.698867319 +0000 UTC m=+38.021602401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls") pod "image-registry-78b89df946-bxpkn" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd") : secret "image-registry-tls" not found Jul 06 19:05:48.199728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g2x\" (UniqueName: \"kubernetes.io/projected/d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392-kube-api-access-b7g2x\") pod \"ingress-canary-wps7n\" (UID: \"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392\") " pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08675e57-5f60-4adc-9155-69928a3bc98f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977afa96-c2d6-4d9f-91aa-25bcba2a898a-tmp\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.198954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d328db8-9434-4028-b5be-112a19959976-config\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.198965 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls podName:d56bb270-2e88-4e18-8586-6232d36fcb69 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.698948407 +0000 UTC m=+38.021683478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5clbg" (UID: "d56bb270-2e88-4e18-8586-6232d36fcb69") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977afa96-c2d6-4d9f-91aa-25bcba2a898a-serving-cert\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb2ff725-e976-42e1-ac97-c0b0d150e281-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-image-registry-private-configuration\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65djw\" (UniqueName: \"kubernetes.io/projected/977afa96-c2d6-4d9f-91aa-25bcba2a898a-kube-api-access-65djw\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-config-volume\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fzkc\" (UniqueName: \"kubernetes.io/projected/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-kube-api-access-5fzkc\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d328db8-9434-4028-b5be-112a19959976-trusted-ca\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.201217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4cv8\" (UniqueName: \"kubernetes.io/projected/eb2ff725-e976-42e1-ac97-c0b0d150e281-kube-api-access-m4cv8\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-ca-trust-extracted\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-installation-pull-secrets\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hw8s\" (UniqueName: \"kubernetes.io/projected/56b3a1a7-9e0a-464b-9c78-9eda9a90bb10-kube-api-access-6hw8s\") pod \"network-check-source-989f8b8dc-wtb8n\" (UID: \"56b3a1a7-9e0a-464b-9c78-9eda9a90bb10\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-config\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-trusted-ca\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8ns6\" (UniqueName: \"kubernetes.io/projected/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-kube-api-access-g8ns6\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb2ff725-e976-42e1-ac97-c0b0d150e281-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977afa96-c2d6-4d9f-91aa-25bcba2a898a-snapshots\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-certificates\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-tmp-dir\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.199731 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d56bb270-2e88-4e18-8586-6232d36fcb69-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.200455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-config\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.200541 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.200591 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.700575673 +0000 UTC m=+38.023310748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : secret "router-metrics-certs-default" not found Jul 06 19:05:48.201916 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.200784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-certificates\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.200974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-trusted-ca\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.201008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977afa96-c2d6-4d9f-91aa-25bcba2a898a-snapshots\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.201046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977afa96-c2d6-4d9f-91aa-25bcba2a898a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.201066 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.201145 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.701127773 +0000 UTC m=+38.023862847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : configmap references non-existent config key: service-ca.crt Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.201167 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert podName:08675e57-5f60-4adc-9155-69928a3bc98f nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.701156028 +0000 UTC m=+38.023891110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nk9xl" (UID: "08675e57-5f60-4adc-9155-69928a3bc98f") : secret "networking-console-plugin-cert" not found Jul 06 19:05:48.202699 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.202358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d328db8-9434-4028-b5be-112a19959976-trusted-ca\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.203664 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.203319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977afa96-c2d6-4d9f-91aa-25bcba2a898a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.203817 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.203792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-installation-pull-secrets\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.203817 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.203802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392-cert\") pod \"ingress-canary-wps7n\" (UID: \"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392\") " pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.203974 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.203816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-stats-auth\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.204308 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.204285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977afa96-c2d6-4d9f-91aa-25bcba2a898a-serving-cert\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.204851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.204827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d328db8-9434-4028-b5be-112a19959976-serving-cert\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.204964 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.204947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-default-certificate\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.205265 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.205233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb2ff725-e976-42e1-ac97-c0b0d150e281-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.205395 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.205378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-image-registry-private-configuration\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.206606 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.206532 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.208360 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.208119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-bound-sa-token\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.208803 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.208784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4nh\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-kube-api-access-2k4nh\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.209018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.208998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px64d\" (UniqueName: \"kubernetes.io/projected/8347f51f-8584-4298-9ca9-c34545507611-kube-api-access-px64d\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.209018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.209009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28tbc\" (UniqueName: \"kubernetes.io/projected/ccf23230-2365-41e2-b5e4-d8c093fdf575-kube-api-access-28tbc\") pod \"volume-data-source-validator-5d456fdbcd-j85zh\" (UID: \"ccf23230-2365-41e2-b5e4-d8c093fdf575\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" Jul 06 19:05:48.209191 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.209108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65djw\" (UniqueName: \"kubernetes.io/projected/977afa96-c2d6-4d9f-91aa-25bcba2a898a-kube-api-access-65djw\") pod \"insights-operator-5c847dcfc4-t8kjl\" (UID: \"977afa96-c2d6-4d9f-91aa-25bcba2a898a\") " pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.210539 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.210518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8785l\" (UniqueName: \"kubernetes.io/projected/d56bb270-2e88-4e18-8586-6232d36fcb69-kube-api-access-8785l\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.210630 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.210609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fzkc\" (UniqueName: \"kubernetes.io/projected/42ef8e5e-4484-47ed-b090-8bf3c0d14c4e-kube-api-access-5fzkc\") pod \"service-ca-operator-5d46d9ffd4-v5b8s\" (UID: \"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.210741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.210723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kff6d\" (UniqueName: \"kubernetes.io/projected/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-kube-api-access-kff6d\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:48.210998 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.210975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4cv8\" (UniqueName: \"kubernetes.io/projected/eb2ff725-e976-42e1-ac97-c0b0d150e281-kube-api-access-m4cv8\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.211063 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.211034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mmn\" (UniqueName: \"kubernetes.io/projected/4d328db8-9434-4028-b5be-112a19959976-kube-api-access-t9mmn\") pod \"console-operator-68b757fb67-4zrmx\" (UID: \"4d328db8-9434-4028-b5be-112a19959976\") " pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.214834 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.214816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb2ff725-e976-42e1-ac97-c0b0d150e281-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kmb2b\" (UID: \"eb2ff725-e976-42e1-ac97-c0b0d150e281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.221077 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.221059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g2x\" (UniqueName: \"kubernetes.io/projected/d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392-kube-api-access-b7g2x\") pod \"ingress-canary-wps7n\" (UID: \"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392\") " pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.280004 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.279976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" Jul 06 19:05:48.300882 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.300852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.301020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.300932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-config-volume\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.301020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.300987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hw8s\" (UniqueName: \"kubernetes.io/projected/56b3a1a7-9e0a-464b-9c78-9eda9a90bb10-kube-api-access-6hw8s\") pod \"network-check-source-989f8b8dc-wtb8n\" (UID: \"56b3a1a7-9e0a-464b-9c78-9eda9a90bb10\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" Jul 06 19:05:48.301020 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.300987 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:05:48.301204 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.301055 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls podName:35bf50e3-0cef-4f19-ac1a-db69fdd210c3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:48.801036435 +0000 UTC m=+38.123771518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls") pod "dns-default-qw8z8" (UID: "35bf50e3-0cef-4f19-ac1a-db69fdd210c3") : secret "dns-default-metrics-tls" not found Jul 06 19:05:48.301204 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.301135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8ns6\" (UniqueName: \"kubernetes.io/projected/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-kube-api-access-g8ns6\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.301204 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.301169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-tmp-dir\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.301521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.301444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-tmp-dir\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.301579 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.301563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-config-volume\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.303548 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.303534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" Jul 06 19:05:48.309746 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.309723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8ns6\" (UniqueName: \"kubernetes.io/projected/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-kube-api-access-g8ns6\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.309918 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.309901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hw8s\" (UniqueName: \"kubernetes.io/projected/56b3a1a7-9e0a-464b-9c78-9eda9a90bb10-kube-api-access-6hw8s\") pod \"network-check-source-989f8b8dc-wtb8n\" (UID: \"56b3a1a7-9e0a-464b-9c78-9eda9a90bb10\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" Jul 06 19:05:48.314701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.314674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" Jul 06 19:05:48.328770 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.328746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:48.336919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.336887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:05:48.337031 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.336928 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:05:48.337237 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.337031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:05:48.339541 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.339518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" Jul 06 19:05:48.340713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.340350 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqvqq\"" Jul 06 19:05:48.340713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.340363 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:05:48.340713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.340374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5h8dt\"" Jul 06 19:05:48.340713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.340534 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:05:48.351117 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.350857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wps7n" Jul 06 19:05:48.362229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.361218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" Jul 06 19:05:48.498497 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.497296 2577 generic.go:356] "Generic (PLEG): container finished" podID="e21d6797-d239-4c0c-9446-0603259981b4" containerID="151c8811d2f3618d4fab2d7e93c2c3f4116da2bd1a2252e4cadf61f73f803d58" exitCode=0 Jul 06 19:05:48.498497 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.497352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerDied","Data":"151c8811d2f3618d4fab2d7e93c2c3f4116da2bd1a2252e4cadf61f73f803d58"} Jul 06 19:05:48.552295 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.549740 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b"] Jul 06 19:05:48.555626 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.555561 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2ff725_e976_42e1_ac97_c0b0d150e281.slice/crio-5a808c75856badfc4050e4c714a1226066c003e224062a4f12451cd06760aedf WatchSource:0}: Error finding container 5a808c75856badfc4050e4c714a1226066c003e224062a4f12451cd06760aedf: Status 404 returned error can't find the container with id 5a808c75856badfc4050e4c714a1226066c003e224062a4f12451cd06760aedf Jul 06 19:05:48.563612 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.563511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s"] Jul 06 19:05:48.564869 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.564851 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh"] Jul 06 19:05:48.569594 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.569558 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ef8e5e_4484_47ed_b090_8bf3c0d14c4e.slice/crio-63b40d0da7a8fd3fd7981316055ae966894ca255a6413f7693bc021acd38ef7f WatchSource:0}: Error finding container 63b40d0da7a8fd3fd7981316055ae966894ca255a6413f7693bc021acd38ef7f: Status 404 returned error can't find the container with id 63b40d0da7a8fd3fd7981316055ae966894ca255a6413f7693bc021acd38ef7f Jul 06 19:05:48.572466 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.572429 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf23230_2365_41e2_b5e4_d8c093fdf575.slice/crio-003905a662af16e752ecf12d70f4bda470ff3678efde2ab7e7874473ebb3a7c8 WatchSource:0}: Error finding container 003905a662af16e752ecf12d70f4bda470ff3678efde2ab7e7874473ebb3a7c8: Status 404 returned error can't find the container with id 003905a662af16e752ecf12d70f4bda470ff3678efde2ab7e7874473ebb3a7c8 Jul 06 19:05:48.595824 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.595743 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4zrmx"] Jul 06 19:05:48.599168 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.599138 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d328db8_9434_4028_b5be_112a19959976.slice/crio-e301356859ece3efbb2e88fce3bbb74039f645b7521231694db20d68c1d3f533 WatchSource:0}: Error finding container e301356859ece3efbb2e88fce3bbb74039f645b7521231694db20d68c1d3f533: Status 404 returned error can't find the container with id e301356859ece3efbb2e88fce3bbb74039f645b7521231694db20d68c1d3f533 Jul 06 19:05:48.602336 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.602117 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wps7n"] Jul 06 19:05:48.606325 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.606300 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fe1e53_1b0a_40c8_84be_fb9c4dbe9392.slice/crio-de44b3b1bd475cc2ebe087da62f066f9a87da402c5a4b1769d7b000925474f17 WatchSource:0}: Error finding container de44b3b1bd475cc2ebe087da62f066f9a87da402c5a4b1769d7b000925474f17: Status 404 returned error can't find the container with id de44b3b1bd475cc2ebe087da62f066f9a87da402c5a4b1769d7b000925474f17 Jul 06 19:05:48.614042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.614017 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-t8kjl"] Jul 06 19:05:48.617864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.617840 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n"] Jul 06 19:05:48.624365 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.624338 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977afa96_c2d6_4d9f_91aa_25bcba2a898a.slice/crio-938e91a176021094903d664b310153810155a688a1d23ec910cebe75ceea9d10 WatchSource:0}: Error finding container 938e91a176021094903d664b310153810155a688a1d23ec910cebe75ceea9d10: Status 404 returned error can't find the container with id 938e91a176021094903d664b310153810155a688a1d23ec910cebe75ceea9d10 Jul 06 19:05:48.624665 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:48.624634 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b3a1a7_9e0a_464b_9c78_9eda9a90bb10.slice/crio-25da1da34981ee9c9971fa61c57223d53aaac0c6cd7e7205b26c8b5c11083d7b WatchSource:0}: Error finding container 25da1da34981ee9c9971fa61c57223d53aaac0c6cd7e7205b26c8b5c11083d7b: Status 404 returned error can't find the container with id 25da1da34981ee9c9971fa61c57223d53aaac0c6cd7e7205b26c8b5c11083d7b Jul 06 19:05:48.708517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.708442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:48.708517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.708480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.708517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.708508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708593 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708612 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.708593611 +0000 UTC m=+39.031328682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : configmap references non-existent config key: service-ca.crt Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708638 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708648 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.708592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708644 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert podName:08675e57-5f60-4adc-9155-69928a3bc98f nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.708628316 +0000 UTC m=+39.031363410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nk9xl" (UID: "08675e57-5f60-4adc-9155-69928a3bc98f") : secret "networking-console-plugin-cert" not found Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708730 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls podName:d56bb270-2e88-4e18-8586-6232d36fcb69 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.708713258 +0000 UTC m=+39.031448343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5clbg" (UID: "d56bb270-2e88-4e18-8586-6232d36fcb69") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:48.708764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708757 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.708745268 +0000 UTC m=+39.031480373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : secret "router-metrics-certs-default" not found Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.708802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.708847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708925 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708958 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708968 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b89df946-bxpkn: secret "image-registry-tls" not found Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708974 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls podName:cd4c20ba-44ae-4a4e-a0ed-58d744237c38 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.708957458 +0000 UTC m=+39.031692532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lcbh4" (UID: "cd4c20ba-44ae-4a4e-a0ed-58d744237c38") : secret "samples-operator-tls" not found Jul 06 19:05:48.709125 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.708995 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls podName:ddf63e1d-d4b5-4e11-89e4-949abc9b17bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.708987429 +0000 UTC m=+39.031722553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls") pod "image-registry-78b89df946-bxpkn" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd") : secret "image-registry-tls" not found Jul 06 19:05:48.770251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.770212 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wcmdx_eb46a76a-5cba-483c-9567-d1a84ed73e5a/konnectivity-agent/0.log" limit=1024 Jul 06 19:05:48.809324 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.809290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:48.809433 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.809417 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:05:48.809485 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:48.809471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls podName:35bf50e3-0cef-4f19-ac1a-db69fdd210c3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:49.809458832 +0000 UTC m=+39.132193904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls") pod "dns-default-qw8z8" (UID: "35bf50e3-0cef-4f19-ac1a-db69fdd210c3") : secret "dns-default-metrics-tls" not found Jul 06 19:05:48.854002 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:48.853950 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wcmdx_eb46a76a-5cba-483c-9567-d1a84ed73e5a/konnectivity-agent/0.log" limit=1024 Jul 06 19:05:49.504565 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.504479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" event={"ID":"977afa96-c2d6-4d9f-91aa-25bcba2a898a","Type":"ContainerStarted","Data":"938e91a176021094903d664b310153810155a688a1d23ec910cebe75ceea9d10"} Jul 06 19:05:49.506978 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.506952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" event={"ID":"eb2ff725-e976-42e1-ac97-c0b0d150e281","Type":"ContainerStarted","Data":"5a808c75856badfc4050e4c714a1226066c003e224062a4f12451cd06760aedf"} Jul 06 19:05:49.513533 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.513511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" event={"ID":"e21d6797-d239-4c0c-9446-0603259981b4","Type":"ContainerStarted","Data":"b6ca1d484f302d127c45e4e40d76b30e1ddc675c919a1a7731bea78aa4b0190a"} Jul 06 19:05:49.518429 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.518405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" event={"ID":"56b3a1a7-9e0a-464b-9c78-9eda9a90bb10","Type":"ContainerStarted","Data":"25da1da34981ee9c9971fa61c57223d53aaac0c6cd7e7205b26c8b5c11083d7b"} Jul 06 19:05:49.523526 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.523289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" event={"ID":"ccf23230-2365-41e2-b5e4-d8c093fdf575","Type":"ContainerStarted","Data":"003905a662af16e752ecf12d70f4bda470ff3678efde2ab7e7874473ebb3a7c8"} Jul 06 19:05:49.525033 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.525010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" event={"ID":"4d328db8-9434-4028-b5be-112a19959976","Type":"ContainerStarted","Data":"e301356859ece3efbb2e88fce3bbb74039f645b7521231694db20d68c1d3f533"} Jul 06 19:05:49.529035 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.529011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" event={"ID":"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e","Type":"ContainerStarted","Data":"63b40d0da7a8fd3fd7981316055ae966894ca255a6413f7693bc021acd38ef7f"} Jul 06 19:05:49.532233 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.532208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wps7n" event={"ID":"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392","Type":"ContainerStarted","Data":"de44b3b1bd475cc2ebe087da62f066f9a87da402c5a4b1769d7b000925474f17"} Jul 06 19:05:49.538226 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.538184 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5kcdz" podStartSLOduration=8.641465488 podStartE2EDuration="38.538169549s" totalImagesPullingTime="29.896704061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:49.536625034 +0000 UTC m=+38.859360128" watchObservedRunningTime="2026-07-06 19:05:49.538169549 +0000 UTC m=+38.860904643" Jul 06 19:05:49.660031 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.659977 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wcmdx_eb46a76a-5cba-483c-9567-d1a84ed73e5a/konnectivity-agent/0.log" limit=1024 Jul 06 19:05:49.718621 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.718582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:49.718847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.718642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:49.718847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.718683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:49.718847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.718743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:49.718847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.718773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:49.718847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.718801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:49.719302 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.718927 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:05:49.719302 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.718987 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.718969611 +0000 UTC m=+41.041704695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : secret "router-metrics-certs-default" not found Jul 06 19:05:49.719428 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719390 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:49.719487 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719444 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls podName:d56bb270-2e88-4e18-8586-6232d36fcb69 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.719428152 +0000 UTC m=+41.042163230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5clbg" (UID: "d56bb270-2e88-4e18-8586-6232d36fcb69") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:49.719543 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719498 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:05:49.719543 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719530 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls podName:cd4c20ba-44ae-4a4e-a0ed-58d744237c38 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.71951894 +0000 UTC m=+41.042254016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lcbh4" (UID: "cd4c20ba-44ae-4a4e-a0ed-58d744237c38") : secret "samples-operator-tls" not found Jul 06 19:05:49.719656 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719589 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:05:49.719656 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719600 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b89df946-bxpkn: secret "image-registry-tls" not found Jul 06 19:05:49.719757 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719658 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls podName:ddf63e1d-d4b5-4e11-89e4-949abc9b17bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.719645638 +0000 UTC m=+41.042380717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls") pod "image-registry-78b89df946-bxpkn" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd") : secret "image-registry-tls" not found Jul 06 19:05:49.719757 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719712 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:05:49.719757 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719742 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert podName:08675e57-5f60-4adc-9155-69928a3bc98f nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.719732495 +0000 UTC m=+41.042467574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nk9xl" (UID: "08675e57-5f60-4adc-9155-69928a3bc98f") : secret "networking-console-plugin-cert" not found Jul 06 19:05:49.719914 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.719806 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.719796101 +0000 UTC m=+41.042531177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : configmap references non-existent config key: service-ca.crt Jul 06 19:05:49.759912 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.759796 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wcmdx_eb46a76a-5cba-483c-9567-d1a84ed73e5a/konnectivity-agent/0.log" limit=1024 Jul 06 19:05:49.820559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:49.820019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:49.820559 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.820192 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:05:49.820559 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:49.820249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls podName:35bf50e3-0cef-4f19-ac1a-db69fdd210c3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:51.820231836 +0000 UTC m=+41.142966913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls") pod "dns-default-qw8z8" (UID: "35bf50e3-0cef-4f19-ac1a-db69fdd210c3") : secret "dns-default-metrics-tls" not found Jul 06 19:05:51.543027 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.542738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" event={"ID":"ccf23230-2365-41e2-b5e4-d8c093fdf575","Type":"ContainerStarted","Data":"0899e4ec159088a69f7feeff8ff346fc177b92c450438c2feaa9f82f0b14b03c"} Jul 06 19:05:51.557838 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.557788 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j85zh" podStartSLOduration=26.309587843 podStartE2EDuration="28.557765396s" totalImagesPullingTime="2.248177553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:51.557110001 +0000 UTC m=+40.879845095" watchObservedRunningTime="2026-07-06 19:05:51.557765396 +0000 UTC m=+40.880500493" Jul 06 19:05:51.738800 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.738751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:51.738987 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.738808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:51.738987 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.738841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:51.738987 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.738931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:51.738987 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.738966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.739011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739038 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739043 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.739023165 +0000 UTC m=+45.061758249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : configmap references non-existent config key: service-ca.crt Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739114 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert podName:08675e57-5f60-4adc-9155-69928a3bc98f nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.739101413 +0000 UTC m=+45.061836491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nk9xl" (UID: "08675e57-5f60-4adc-9155-69928a3bc98f") : secret "networking-console-plugin-cert" not found Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739125 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739140 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b89df946-bxpkn: secret "image-registry-tls" not found Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls podName:ddf63e1d-d4b5-4e11-89e4-949abc9b17bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.739173653 +0000 UTC m=+45.061908747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls") pod "image-registry-78b89df946-bxpkn" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd") : secret "image-registry-tls" not found Jul 06 19:05:51.739239 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739234 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:51.739652 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739277 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls podName:d56bb270-2e88-4e18-8586-6232d36fcb69 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.739266933 +0000 UTC m=+45.062002012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5clbg" (UID: "d56bb270-2e88-4e18-8586-6232d36fcb69") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:51.739652 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739277 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:05:51.739652 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739318 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls podName:cd4c20ba-44ae-4a4e-a0ed-58d744237c38 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.739306183 +0000 UTC m=+45.062041258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lcbh4" (UID: "cd4c20ba-44ae-4a4e-a0ed-58d744237c38") : secret "samples-operator-tls" not found Jul 06 19:05:51.739652 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739342 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:05:51.739652 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.739394 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.739379025 +0000 UTC m=+45.062114111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : secret "router-metrics-certs-default" not found Jul 06 19:05:51.840062 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:51.839970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:51.840248 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.840173 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:05:51.840311 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:51.840253 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls podName:35bf50e3-0cef-4f19-ac1a-db69fdd210c3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:55.840233198 +0000 UTC m=+45.162968271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls") pod "dns-default-qw8z8" (UID: "35bf50e3-0cef-4f19-ac1a-db69fdd210c3") : secret "dns-default-metrics-tls" not found Jul 06 19:05:55.773594 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.773553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.773611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.773655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.773701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773724 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773785 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773797 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls podName:d56bb270-2e88-4e18-8586-6232d36fcb69 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.773777968 +0000 UTC m=+53.096513060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5clbg" (UID: "d56bb270-2e88-4e18-8586-6232d36fcb69") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773823 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.773805259 +0000 UTC m=+53.096540330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : configmap references non-existent config key: service-ca.crt Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.773733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773842 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls podName:cd4c20ba-44ae-4a4e-a0ed-58d744237c38 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.773831512 +0000 UTC m=+53.096566587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lcbh4" (UID: "cd4c20ba-44ae-4a4e-a0ed-58d744237c38") : secret "samples-operator-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773846 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773868 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b89df946-bxpkn: secret "image-registry-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773885 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773905 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.773867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773931 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls podName:ddf63e1d-d4b5-4e11-89e4-949abc9b17bd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.773916475 +0000 UTC m=+53.096651548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls") pod "image-registry-78b89df946-bxpkn" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd") : secret "image-registry-tls" not found Jul 06 19:05:55.774348 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773983 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.773973917 +0000 UTC m=+53.096708989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : secret "router-metrics-certs-default" not found Jul 06 19:05:55.774960 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.773996 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert podName:08675e57-5f60-4adc-9155-69928a3bc98f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.773990074 +0000 UTC m=+53.096725146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nk9xl" (UID: "08675e57-5f60-4adc-9155-69928a3bc98f") : secret "networking-console-plugin-cert" not found Jul 06 19:05:55.875150 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:55.875109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:05:55.875324 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.875262 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:05:55.875324 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:55.875318 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls podName:35bf50e3-0cef-4f19-ac1a-db69fdd210c3 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.875304312 +0000 UTC m=+53.198039383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls") pod "dns-default-qw8z8" (UID: "35bf50e3-0cef-4f19-ac1a-db69fdd210c3") : secret "dns-default-metrics-tls" not found Jul 06 19:05:56.559266 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.558999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" event={"ID":"56b3a1a7-9e0a-464b-9c78-9eda9a90bb10","Type":"ContainerStarted","Data":"17d24f54b4fc79c3056c77b0198cd22c6399b39a5d0e00c632387534c6024557"} Jul 06 19:05:56.560965 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.560943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/0.log" Jul 06 19:05:56.561114 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.560987 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d328db8-9434-4028-b5be-112a19959976" containerID="0d48e2dc1e920e84fac52949bde2c06060e7228aa6fec5fa5fcfab3a6f64c21a" exitCode=255 Jul 06 19:05:56.561114 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.561060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" event={"ID":"4d328db8-9434-4028-b5be-112a19959976","Type":"ContainerDied","Data":"0d48e2dc1e920e84fac52949bde2c06060e7228aa6fec5fa5fcfab3a6f64c21a"} Jul 06 19:05:56.561346 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.561328 2577 scope.go:117] "RemoveContainer" containerID="0d48e2dc1e920e84fac52949bde2c06060e7228aa6fec5fa5fcfab3a6f64c21a" Jul 06 19:05:56.563519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.563495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" event={"ID":"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e","Type":"ContainerStarted","Data":"d33a68a81fe19a1c15ffd53e203cd0056cfa348950cd38e05d07d2783a17f965"} Jul 06 19:05:56.565680 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.565658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wps7n" event={"ID":"d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392","Type":"ContainerStarted","Data":"88b331e4886a784b027238a9ead81d6b3f45709b6fef8ca32c07e4e1827952d4"} Jul 06 19:05:56.567391 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.567369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" event={"ID":"977afa96-c2d6-4d9f-91aa-25bcba2a898a","Type":"ContainerStarted","Data":"0876e0f35dd5db62069e20950dde7742ee2e8c755a6fd77ea88d6ba3255ce325"} Jul 06 19:05:56.568807 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.568789 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" event={"ID":"eb2ff725-e976-42e1-ac97-c0b0d150e281","Type":"ContainerStarted","Data":"d0a977f4d8bcd16c774bc32f96aa6fc6b4c764ee13676c667a89254cbf3e1259"} Jul 06 19:05:56.575867 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.575813 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wtb8n" podStartSLOduration=26.062163201 podStartE2EDuration="33.575797167s" totalImagesPullingTime="7.513633966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:56.574607137 +0000 UTC m=+45.897342233" watchObservedRunningTime="2026-07-06 19:05:56.575797167 +0000 UTC m=+45.898532253" Jul 06 19:05:56.599865 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.598519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wps7n" podStartSLOduration=2.078014808 podStartE2EDuration="9.598502162s" totalImagesPullingTime="7.520487354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:56.598028567 +0000 UTC m=+45.920763661" watchObservedRunningTime="2026-07-06 19:05:56.598502162 +0000 UTC m=+45.921237258" Jul 06 19:05:56.637184 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.636954 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" podStartSLOduration=26.134687201 podStartE2EDuration="33.636913945s" totalImagesPullingTime="7.502226744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:56.635360498 +0000 UTC m=+45.958095593" watchObservedRunningTime="2026-07-06 19:05:56.636913945 +0000 UTC m=+45.959649039" Jul 06 19:05:56.670817 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.670771 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" podStartSLOduration=26.122860733 podStartE2EDuration="33.670752492s" totalImagesPullingTime="7.547891759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:56.653646983 +0000 UTC m=+45.976382078" watchObservedRunningTime="2026-07-06 19:05:56.670752492 +0000 UTC m=+45.993487589" Jul 06 19:05:56.671737 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:56.671700 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" podStartSLOduration=26.109782485 podStartE2EDuration="33.671688947s" totalImagesPullingTime="7.561906462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:56.670190574 +0000 UTC m=+45.992925662" watchObservedRunningTime="2026-07-06 19:05:56.671688947 +0000 UTC m=+45.994424044" Jul 06 19:05:57.433024 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.432939 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h5g6l"] Jul 06 19:05:57.468843 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.468815 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5g6l"] Jul 06 19:05:57.469074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.468933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.472242 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.471983 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:05:57.472242 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.472104 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:05:57.472408 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.472345 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgwxd\"" Jul 06 19:05:57.488977 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.488958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5911212a-ad7f-476f-8d32-c0dd65ac61ae-crio-socket\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.489048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.488994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nqm\" (UniqueName: \"kubernetes.io/projected/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-api-access-x7nqm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.489048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.489034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5911212a-ad7f-476f-8d32-c0dd65ac61ae-data-volume\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.489176 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.489153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.489263 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.489246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.574482 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.574462 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/1.log" Jul 06 19:05:57.574995 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.574968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/0.log" Jul 06 19:05:57.575099 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.575010 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d328db8-9434-4028-b5be-112a19959976" containerID="3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9" exitCode=255 Jul 06 19:05:57.575163 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.575102 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" event={"ID":"4d328db8-9434-4028-b5be-112a19959976","Type":"ContainerDied","Data":"3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9"} Jul 06 19:05:57.575163 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.575149 2577 scope.go:117] "RemoveContainer" containerID="0d48e2dc1e920e84fac52949bde2c06060e7228aa6fec5fa5fcfab3a6f64c21a" Jul 06 19:05:57.575455 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.575362 2577 scope.go:117] "RemoveContainer" containerID="3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9" Jul 06 19:05:57.575835 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:57.575553 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4zrmx_openshift-console-operator(4d328db8-9434-4028-b5be-112a19959976)\"" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podUID="4d328db8-9434-4028-b5be-112a19959976" Jul 06 19:05:57.590229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.590210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5911212a-ad7f-476f-8d32-c0dd65ac61ae-data-volume\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.590372 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.590333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.590451 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.590434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.590593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.590577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5911212a-ad7f-476f-8d32-c0dd65ac61ae-crio-socket\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.590662 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.590634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nqm\" (UniqueName: \"kubernetes.io/projected/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-api-access-x7nqm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.590968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.590943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5911212a-ad7f-476f-8d32-c0dd65ac61ae-data-volume\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.591297 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:57.591268 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:05:57.591388 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:57.591339 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.091318512 +0000 UTC m=+47.414053596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : secret "insights-runtime-extractor-tls" not found Jul 06 19:05:57.591458 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:57.591421 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:05:57.591515 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:57.591461 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.091448637 +0000 UTC m=+47.414183716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : configmap "kube-rbac-proxy" not found Jul 06 19:05:57.591683 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.591663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5911212a-ad7f-476f-8d32-c0dd65ac61ae-crio-socket\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:57.601957 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:57.601931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nqm\" (UniqueName: \"kubernetes.io/projected/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-api-access-x7nqm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:58.060889 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.060858 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9"] Jul 06 19:05:58.091968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.091943 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9"] Jul 06 19:05:58.092119 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.092075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" Jul 06 19:05:58.094906 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.094883 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zdbr2\"" Jul 06 19:05:58.095036 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.094880 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:58.095924 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.095900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:58.097135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.096059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:58.097135 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:58.096131 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:05:58.097135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.096198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 19:05:58.097135 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:58.096229 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:05:59.09618564 +0000 UTC m=+48.418920726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : secret "insights-runtime-extractor-tls" not found Jul 06 19:05:58.097135 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:58.096253 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:05:58.097135 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:58.096495 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:05:59.096451423 +0000 UTC m=+48.419186499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : configmap "kube-rbac-proxy" not found Jul 06 19:05:58.196943 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.196910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwpbx\" (UniqueName: \"kubernetes.io/projected/78ca1af4-e22b-4875-98e6-b538823054b6-kube-api-access-rwpbx\") pod \"migrator-d57d58cc9-6hdm9\" (UID: \"78ca1af4-e22b-4875-98e6-b538823054b6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" Jul 06 19:05:58.298043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.298004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwpbx\" (UniqueName: \"kubernetes.io/projected/78ca1af4-e22b-4875-98e6-b538823054b6-kube-api-access-rwpbx\") pod \"migrator-d57d58cc9-6hdm9\" (UID: \"78ca1af4-e22b-4875-98e6-b538823054b6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" Jul 06 19:05:58.306135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.306079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwpbx\" (UniqueName: \"kubernetes.io/projected/78ca1af4-e22b-4875-98e6-b538823054b6-kube-api-access-rwpbx\") pod \"migrator-d57d58cc9-6hdm9\" (UID: \"78ca1af4-e22b-4875-98e6-b538823054b6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" Jul 06 19:05:58.328992 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.328936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:58.329109 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.329006 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:05:58.405124 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.405094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" Jul 06 19:05:58.438754 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.438733 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xg6g_a669b24a-1165-42d2-b60f-8bc7255f85b9/dns-node-resolver/0.log" Jul 06 19:05:58.542696 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.542619 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9"] Jul 06 19:05:58.545230 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:05:58.545205 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ca1af4_e22b_4875_98e6_b538823054b6.slice/crio-01ea9a83ad38ea87fc1bc3ff7612f73fd805664547ccda3823d0aaa0c67244c5 WatchSource:0}: Error finding container 01ea9a83ad38ea87fc1bc3ff7612f73fd805664547ccda3823d0aaa0c67244c5: Status 404 returned error can't find the container with id 01ea9a83ad38ea87fc1bc3ff7612f73fd805664547ccda3823d0aaa0c67244c5 Jul 06 19:05:58.579788 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.579734 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/1.log" Jul 06 19:05:58.580095 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.580069 2577 scope.go:117] "RemoveContainer" containerID="3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9" Jul 06 19:05:58.580277 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:58.580257 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4zrmx_openshift-console-operator(4d328db8-9434-4028-b5be-112a19959976)\"" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podUID="4d328db8-9434-4028-b5be-112a19959976" Jul 06 19:05:58.580894 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:58.580872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" event={"ID":"78ca1af4-e22b-4875-98e6-b538823054b6","Type":"ContainerStarted","Data":"01ea9a83ad38ea87fc1bc3ff7612f73fd805664547ccda3823d0aaa0c67244c5"} Jul 06 19:05:59.106412 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:59.106379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:59.106584 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:59.106470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:05:59.106584 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:59.106524 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:05:59.106704 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:59.106601 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.106578855 +0000 UTC m=+50.429313947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : configmap "kube-rbac-proxy" not found Jul 06 19:05:59.106704 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:59.106527 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:05:59.106704 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:59.106661 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.106649218 +0000 UTC m=+50.429384294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : secret "insights-runtime-extractor-tls" not found Jul 06 19:05:59.586601 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:59.586572 2577 scope.go:117] "RemoveContainer" containerID="3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9" Jul 06 19:05:59.587073 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:05:59.586782 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4zrmx_openshift-console-operator(4d328db8-9434-4028-b5be-112a19959976)\"" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podUID="4d328db8-9434-4028-b5be-112a19959976" Jul 06 19:05:59.838854 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:05:59.838787 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lxg4q_75e44a91-97d0-4697-86f9-d018aa5972d5/node-ca/0.log" Jul 06 19:06:00.238229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.238192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wps7n_d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392/serve-healthcheck-canary/0.log" Jul 06 19:06:00.732478 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.732450 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m75bp"] Jul 06 19:06:00.747901 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.747878 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m75bp"] Jul 06 19:06:00.748045 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.747969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.750791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.750768 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 19:06:00.750962 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.750946 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 19:06:00.751955 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.751934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qcghn\"" Jul 06 19:06:00.752104 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.751961 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 19:06:00.752104 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.751934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 19:06:00.825661 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.825631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3af32c98-9d9e-4273-b7b6-64559eb92727-signing-cabundle\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.825811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.825706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgwz\" (UniqueName: \"kubernetes.io/projected/3af32c98-9d9e-4273-b7b6-64559eb92727-kube-api-access-sdgwz\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.825811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.825727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3af32c98-9d9e-4273-b7b6-64559eb92727-signing-key\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.926788 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.926760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3af32c98-9d9e-4273-b7b6-64559eb92727-signing-cabundle\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.926952 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.926836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgwz\" (UniqueName: \"kubernetes.io/projected/3af32c98-9d9e-4273-b7b6-64559eb92727-kube-api-access-sdgwz\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.926952 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.926862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3af32c98-9d9e-4273-b7b6-64559eb92727-signing-key\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.927528 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.927507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3af32c98-9d9e-4273-b7b6-64559eb92727-signing-cabundle\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.929157 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.929141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3af32c98-9d9e-4273-b7b6-64559eb92727-signing-key\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:00.935259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:00.935230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgwz\" (UniqueName: \"kubernetes.io/projected/3af32c98-9d9e-4273-b7b6-64559eb92727-kube-api-access-sdgwz\") pod \"service-ca-758f599c5-m75bp\" (UID: \"3af32c98-9d9e-4273-b7b6-64559eb92727\") " pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:01.057596 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.057573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-m75bp" Jul 06 19:06:01.128819 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.128793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:01.128981 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.128857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:01.128981 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:01.128962 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:06:01.129118 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:01.128997 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:06:01.129118 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:01.129016 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:05.129003198 +0000 UTC m=+54.451738274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : secret "insights-runtime-extractor-tls" not found Jul 06 19:06:01.129118 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:01.129051 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:05.129035077 +0000 UTC m=+54.451770153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : configmap "kube-rbac-proxy" not found Jul 06 19:06:01.192026 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.191941 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m75bp"] Jul 06 19:06:01.194527 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:01.194501 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af32c98_9d9e_4273_b7b6_64559eb92727.slice/crio-0a18574418d997de1a05b65b874c9df300129ce1776ffe7ec16b2d153b153d14 WatchSource:0}: Error finding container 0a18574418d997de1a05b65b874c9df300129ce1776ffe7ec16b2d153b153d14: Status 404 returned error can't find the container with id 0a18574418d997de1a05b65b874c9df300129ce1776ffe7ec16b2d153b153d14 Jul 06 19:06:01.595380 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.595285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" event={"ID":"78ca1af4-e22b-4875-98e6-b538823054b6","Type":"ContainerStarted","Data":"6029b76d9f8c9844f53cdec64aa0a5fcff9a0cc27ff62738455559090a84f764"} Jul 06 19:06:01.595380 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.595360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" event={"ID":"78ca1af4-e22b-4875-98e6-b538823054b6","Type":"ContainerStarted","Data":"757aa2a4549f1d53bca5c8b9c16231e970c44a3b6b53b0c2bf40614a64fb0fad"} Jul 06 19:06:01.596710 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.596682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-m75bp" event={"ID":"3af32c98-9d9e-4273-b7b6-64559eb92727","Type":"ContainerStarted","Data":"dd3a51f0d655559a384b4f8143db6d93f7c7152d397111e797cbfc4195477d91"} Jul 06 19:06:01.596817 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.596730 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-m75bp" event={"ID":"3af32c98-9d9e-4273-b7b6-64559eb92727","Type":"ContainerStarted","Data":"0a18574418d997de1a05b65b874c9df300129ce1776ffe7ec16b2d153b153d14"} Jul 06 19:06:01.612353 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.612310 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hdm9" podStartSLOduration=1.312376876 podStartE2EDuration="3.612296067s" totalImagesPullingTime="2.299919191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:01.611684081 +0000 UTC m=+50.934419185" watchObservedRunningTime="2026-07-06 19:06:01.612296067 +0000 UTC m=+50.935031161" Jul 06 19:06:01.625954 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:01.625907 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-m75bp" podStartSLOduration=1.625892142 podStartE2EDuration="1.625892142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:01.625586045 +0000 UTC m=+50.948321140" watchObservedRunningTime="2026-07-06 19:06:01.625892142 +0000 UTC m=+50.948627235" Jul 06 19:06:03.857443 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.857404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:06:03.857443 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.857450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.857472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.857538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.857560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857564 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857589 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:19.85756663 +0000 UTC m=+69.180301721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : configmap references non-existent config key: service-ca.crt Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857630 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert podName:08675e57-5f60-4adc-9155-69928a3bc98f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:19.857612361 +0000 UTC m=+69.180347451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nk9xl" (UID: "08675e57-5f60-4adc-9155-69928a3bc98f") : secret "networking-console-plugin-cert" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857642 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857665 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857694 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs podName:8347f51f-8584-4298-9ca9-c34545507611 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:19.857681896 +0000 UTC m=+69.180416981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs") pod "router-default-7f65c66c8f-qrlzn" (UID: "8347f51f-8584-4298-9ca9-c34545507611") : secret "router-metrics-certs-default" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857726 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls podName:d56bb270-2e88-4e18-8586-6232d36fcb69 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:19.857713594 +0000 UTC m=+69.180448667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5clbg" (UID: "d56bb270-2e88-4e18-8586-6232d36fcb69") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.857671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857735 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857836 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b89df946-bxpkn: secret "image-registry-tls" not found Jul 06 19:06:03.857937 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.857911 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls podName:ddf63e1d-d4b5-4e11-89e4-949abc9b17bd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:19.857892651 +0000 UTC m=+69.180627732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls") pod "image-registry-78b89df946-bxpkn" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd") : secret "image-registry-tls" not found Jul 06 19:06:03.859890 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.859865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd4c20ba-44ae-4a4e-a0ed-58d744237c38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lcbh4\" (UID: \"cd4c20ba-44ae-4a4e-a0ed-58d744237c38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:06:03.921989 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.921960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" Jul 06 19:06:03.959214 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:03.959190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:06:03.959379 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.959361 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:03.959456 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:03.959437 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls podName:35bf50e3-0cef-4f19-ac1a-db69fdd210c3 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:19.959416735 +0000 UTC m=+69.282151806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls") pod "dns-default-qw8z8" (UID: "35bf50e3-0cef-4f19-ac1a-db69fdd210c3") : secret "dns-default-metrics-tls" not found Jul 06 19:06:04.066258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:04.066198 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4"] Jul 06 19:06:04.609028 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:04.608989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" event={"ID":"cd4c20ba-44ae-4a4e-a0ed-58d744237c38","Type":"ContainerStarted","Data":"d47c3b4e73862c985bd1b1fb1f5b88a3f88ddf91d6e13bd589ab4dd9c6ac03bd"} Jul 06 19:06:05.171282 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:05.171241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:05.171764 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:05.171332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:05.171764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:05.171408 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:06:05.171764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:05.171487 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.171466292 +0000 UTC m=+62.494201369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : secret "insights-runtime-extractor-tls" not found Jul 06 19:06:05.171764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:05.171488 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:06:05.171764 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:05.171539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm podName:5911212a-ad7f-476f-8d32-c0dd65ac61ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.1715241 +0000 UTC m=+62.494259179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5g6l" (UID: "5911212a-ad7f-476f-8d32-c0dd65ac61ae") : configmap "kube-rbac-proxy" not found Jul 06 19:06:07.620653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:07.620607 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" event={"ID":"cd4c20ba-44ae-4a4e-a0ed-58d744237c38","Type":"ContainerStarted","Data":"45bb982af0a339fc3578f8fa2e18c5ddbd5352452f3380ce1490ad7e4621f8e9"} Jul 06 19:06:07.621009 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:07.620669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" event={"ID":"cd4c20ba-44ae-4a4e-a0ed-58d744237c38","Type":"ContainerStarted","Data":"965061a801f640e55e5aa0681bde52904f2d42eb7c39dafa25c993de24384c27"} Jul 06 19:06:07.637549 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:07.637501 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lcbh4" podStartSLOduration=41.894207804 podStartE2EDuration="44.637487297s" totalImagesPullingTime="2.743279493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:07.637011882 +0000 UTC m=+56.959746975" watchObservedRunningTime="2026-07-06 19:06:07.637487297 +0000 UTC m=+56.960222391" Jul 06 19:06:13.244841 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.244786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:13.245341 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.244885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:13.245544 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.245509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5911212a-ad7f-476f-8d32-c0dd65ac61ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:13.247167 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.247145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5911212a-ad7f-476f-8d32-c0dd65ac61ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5g6l\" (UID: \"5911212a-ad7f-476f-8d32-c0dd65ac61ae\") " pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:13.337367 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.337345 2577 scope.go:117] "RemoveContainer" containerID="3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9" Jul 06 19:06:13.383546 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.383527 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgwxd\"" Jul 06 19:06:13.390849 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.390827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5g6l" Jul 06 19:06:13.488752 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.488571 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjxq8" Jul 06 19:06:13.518892 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.518821 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5g6l"] Jul 06 19:06:13.521447 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:13.521424 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5911212a_ad7f_476f_8d32_c0dd65ac61ae.slice/crio-864f5a51de3bfbd11555426af9da1797b667219871e2a2def4aa44755d056d3f WatchSource:0}: Error finding container 864f5a51de3bfbd11555426af9da1797b667219871e2a2def4aa44755d056d3f: Status 404 returned error can't find the container with id 864f5a51de3bfbd11555426af9da1797b667219871e2a2def4aa44755d056d3f Jul 06 19:06:13.640836 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.640809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:06:13.641241 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.641227 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/1.log" Jul 06 19:06:13.641297 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.641259 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d328db8-9434-4028-b5be-112a19959976" containerID="569d8282afa5499bd4e08e1b3274d2991caa092b760d74a77d088d9dcfff34f7" exitCode=255 Jul 06 19:06:13.641349 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.641335 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" event={"ID":"4d328db8-9434-4028-b5be-112a19959976","Type":"ContainerDied","Data":"569d8282afa5499bd4e08e1b3274d2991caa092b760d74a77d088d9dcfff34f7"} Jul 06 19:06:13.641397 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.641388 2577 scope.go:117] "RemoveContainer" containerID="3286abe53a0a5d81c419377d872c249a700e4f8af009c8d139f57e5165e498b9" Jul 06 19:06:13.641738 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.641715 2577 scope.go:117] "RemoveContainer" containerID="569d8282afa5499bd4e08e1b3274d2991caa092b760d74a77d088d9dcfff34f7" Jul 06 19:06:13.641929 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:13.641907 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-4zrmx_openshift-console-operator(4d328db8-9434-4028-b5be-112a19959976)\"" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podUID="4d328db8-9434-4028-b5be-112a19959976" Jul 06 19:06:13.642502 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:13.642448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5g6l" event={"ID":"5911212a-ad7f-476f-8d32-c0dd65ac61ae","Type":"ContainerStarted","Data":"864f5a51de3bfbd11555426af9da1797b667219871e2a2def4aa44755d056d3f"} Jul 06 19:06:14.648044 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:14.648018 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:06:16.880812 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:16.880773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:06:16.883734 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:16.883710 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:06:16.893748 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:16.893728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b22251-5299-42cf-9373-759be5b5ae9c-original-pull-secret\") pod \"global-pull-secret-syncer-7l5n8\" (UID: \"a1b22251-5299-42cf-9373-759be5b5ae9c\") " pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:06:16.982276 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:16.982241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:06:16.985199 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:16.984957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:06:16.995712 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:16.995683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b23d0b-3347-4b1b-9af2-650ff6fd6c04-metrics-certs\") pod \"network-metrics-daemon-kj9q9\" (UID: \"92b23d0b-3347-4b1b-9af2-650ff6fd6c04\") " pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:06:17.083365 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.083323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:06:17.085854 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.085830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqf7h\" (UniqueName: \"kubernetes.io/projected/e30d0c8a-d5a3-4227-a519-e07f6b2c2292-kube-api-access-mqf7h\") pod \"network-check-target-vqgc5\" (UID: \"e30d0c8a-d5a3-4227-a519-e07f6b2c2292\") " pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:06:17.155531 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.155500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5h8dt\"" Jul 06 19:06:17.163033 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.163009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:06:17.164318 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.164295 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqvqq\"" Jul 06 19:06:17.172114 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.172097 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj9q9" Jul 06 19:06:17.174774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.174757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7l5n8" Jul 06 19:06:17.719810 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.719771 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7l5n8"] Jul 06 19:06:17.723301 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:17.723277 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b22251_5299_42cf_9373_759be5b5ae9c.slice/crio-b7b3ad8e9eebdfab548a48783760b6ac1618e0db34edfbf7aa180b324d43445b WatchSource:0}: Error finding container b7b3ad8e9eebdfab548a48783760b6ac1618e0db34edfbf7aa180b324d43445b: Status 404 returned error can't find the container with id b7b3ad8e9eebdfab548a48783760b6ac1618e0db34edfbf7aa180b324d43445b Jul 06 19:06:17.943914 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.943886 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqgc5"] Jul 06 19:06:17.946599 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:17.946574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kj9q9"] Jul 06 19:06:17.947628 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:17.947601 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30d0c8a_d5a3_4227_a519_e07f6b2c2292.slice/crio-08f19767bfb57180fa4b7f44fa3bea2e47951095186c3b8ce0fb95134b8d8d21 WatchSource:0}: Error finding container 08f19767bfb57180fa4b7f44fa3bea2e47951095186c3b8ce0fb95134b8d8d21: Status 404 returned error can't find the container with id 08f19767bfb57180fa4b7f44fa3bea2e47951095186c3b8ce0fb95134b8d8d21 Jul 06 19:06:17.949302 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:17.949282 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b23d0b_3347_4b1b_9af2_650ff6fd6c04.slice/crio-76056c41b3823834070b423ba93fcb7decdf175741db19a27891b07263e2410a WatchSource:0}: Error finding container 76056c41b3823834070b423ba93fcb7decdf175741db19a27891b07263e2410a: Status 404 returned error can't find the container with id 76056c41b3823834070b423ba93fcb7decdf175741db19a27891b07263e2410a Jul 06 19:06:18.329405 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.329326 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:06:18.329405 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.329376 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:06:18.329717 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.329700 2577 scope.go:117] "RemoveContainer" containerID="569d8282afa5499bd4e08e1b3274d2991caa092b760d74a77d088d9dcfff34f7" Jul 06 19:06:18.329893 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:18.329872 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-4zrmx_openshift-console-operator(4d328db8-9434-4028-b5be-112a19959976)\"" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podUID="4d328db8-9434-4028-b5be-112a19959976" Jul 06 19:06:18.670665 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.670598 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7l5n8" event={"ID":"a1b22251-5299-42cf-9373-759be5b5ae9c","Type":"ContainerStarted","Data":"b7b3ad8e9eebdfab548a48783760b6ac1618e0db34edfbf7aa180b324d43445b"} Jul 06 19:06:18.672153 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.672067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj9q9" event={"ID":"92b23d0b-3347-4b1b-9af2-650ff6fd6c04","Type":"ContainerStarted","Data":"76056c41b3823834070b423ba93fcb7decdf175741db19a27891b07263e2410a"} Jul 06 19:06:18.673944 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.673883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5g6l" event={"ID":"5911212a-ad7f-476f-8d32-c0dd65ac61ae","Type":"ContainerStarted","Data":"947f3813666be5c165c323509b6308b2a0bb3ff18ede5bb65b91fbe546d8effd"} Jul 06 19:06:18.675841 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.675812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqgc5" event={"ID":"e30d0c8a-d5a3-4227-a519-e07f6b2c2292","Type":"ContainerStarted","Data":"4ec81d84794fb4f4b180bc2bd737877d2b37ae901f4362f9abba34214a8fd96e"} Jul 06 19:06:18.676041 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.675862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqgc5" event={"ID":"e30d0c8a-d5a3-4227-a519-e07f6b2c2292","Type":"ContainerStarted","Data":"08f19767bfb57180fa4b7f44fa3bea2e47951095186c3b8ce0fb95134b8d8d21"} Jul 06 19:06:18.676199 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.676125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:06:18.692624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:18.692581 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vqgc5" podStartSLOduration=67.692565615 podStartE2EDuration="1m7.692565615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:18.690504596 +0000 UTC m=+68.013239692" watchObservedRunningTime="2026-07-06 19:06:18.692565615 +0000 UTC m=+68.015300710" Jul 06 19:06:19.681539 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.681508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5g6l" event={"ID":"5911212a-ad7f-476f-8d32-c0dd65ac61ae","Type":"ContainerStarted","Data":"5212af2face898568cb43a00d98f87fce025816ad2b49bb0e7abe36fe6038fa4"} Jul 06 19:06:19.683676 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.683649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj9q9" event={"ID":"92b23d0b-3347-4b1b-9af2-650ff6fd6c04","Type":"ContainerStarted","Data":"31da1c89b480d42235c76603b6a5ed7df21539b97284c9e02f467864e0db89d3"} Jul 06 19:06:19.683791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.683701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj9q9" event={"ID":"92b23d0b-3347-4b1b-9af2-650ff6fd6c04","Type":"ContainerStarted","Data":"6f11201ef8efe27e748b79563a3a0ed92dbf9ec2dd0362b56e98e8f66aa1660e"} Jul 06 19:06:19.701123 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.701022 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kj9q9" podStartSLOduration=67.187425913 podStartE2EDuration="1m8.701008507s" totalImagesPullingTime="1.513582594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:19.699733121 +0000 UTC m=+69.022468237" watchObservedRunningTime="2026-07-06 19:06:19.701008507 +0000 UTC m=+69.023743600" Jul 06 19:06:19.908234 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.908184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:06:19.908234 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.908249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:06:19.908471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.908293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:06:19.908471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.908313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:19.908471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.908334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:19.909026 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.908996 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8347f51f-8584-4298-9ca9-c34545507611-service-ca-bundle\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:19.910717 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.910692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"image-registry-78b89df946-bxpkn\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:06:19.910833 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.910757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8347f51f-8584-4298-9ca9-c34545507611-metrics-certs\") pod \"router-default-7f65c66c8f-qrlzn\" (UID: \"8347f51f-8584-4298-9ca9-c34545507611\") " pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:19.911035 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.911018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08675e57-5f60-4adc-9155-69928a3bc98f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nk9xl\" (UID: \"08675e57-5f60-4adc-9155-69928a3bc98f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:06:19.911305 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:19.911283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d56bb270-2e88-4e18-8586-6232d36fcb69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5clbg\" (UID: \"d56bb270-2e88-4e18-8586-6232d36fcb69\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:06:20.009408 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.009332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:06:20.011812 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.011792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35bf50e3-0cef-4f19-ac1a-db69fdd210c3-metrics-tls\") pod \"dns-default-qw8z8\" (UID: \"35bf50e3-0cef-4f19-ac1a-db69fdd210c3\") " pod="openshift-dns/dns-default-qw8z8" Jul 06 19:06:20.063836 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.063806 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dj2cn\"" Jul 06 19:06:20.072078 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.072038 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:06:20.093688 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.093653 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fsqd5\"" Jul 06 19:06:20.102039 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.102012 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" Jul 06 19:06:20.136906 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.136874 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lnzhx\"" Jul 06 19:06:20.144745 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.144526 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:20.150558 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.150362 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4w4sn\"" Jul 06 19:06:20.157974 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.157801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" Jul 06 19:06:20.159420 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.159217 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mb8mb\"" Jul 06 19:06:20.167601 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.167451 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qw8z8" Jul 06 19:06:20.265101 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.264942 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b89df946-bxpkn"] Jul 06 19:06:20.274921 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:20.274883 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf63e1d_d4b5_4e11_89e4_949abc9b17bd.slice/crio-d97dba07a3cf2aeb28ca47cc0def040c72349307a4167fb51bb2312767debf54 WatchSource:0}: Error finding container d97dba07a3cf2aeb28ca47cc0def040c72349307a4167fb51bb2312767debf54: Status 404 returned error can't find the container with id d97dba07a3cf2aeb28ca47cc0def040c72349307a4167fb51bb2312767debf54 Jul 06 19:06:20.315143 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.314520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg"] Jul 06 19:06:20.359799 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.359681 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f65c66c8f-qrlzn"] Jul 06 19:06:20.396477 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.388243 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl"] Jul 06 19:06:20.415246 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.415178 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qw8z8"] Jul 06 19:06:20.423413 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:20.423387 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bf50e3_0cef_4f19_ac1a_db69fdd210c3.slice/crio-6e2a85074408c0ae98c9c1a85d90c2f2401b4236fde8aee008ef69eae1f1b5e5 WatchSource:0}: Error finding container 6e2a85074408c0ae98c9c1a85d90c2f2401b4236fde8aee008ef69eae1f1b5e5: Status 404 returned error can't find the container with id 6e2a85074408c0ae98c9c1a85d90c2f2401b4236fde8aee008ef69eae1f1b5e5 Jul 06 19:06:20.690983 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.690879 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" event={"ID":"8347f51f-8584-4298-9ca9-c34545507611","Type":"ContainerStarted","Data":"f5e03b621451a105105d6aeb26ac5e20f0c459b6617d83eeb9d73bb91c2eec9b"} Jul 06 19:06:20.690983 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.690943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" event={"ID":"8347f51f-8584-4298-9ca9-c34545507611","Type":"ContainerStarted","Data":"07dad3dd334753295afe13f8cab5f684ae7d0c2b555e694f4049d2f96a1dfdee"} Jul 06 19:06:20.693098 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.693017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qw8z8" event={"ID":"35bf50e3-0cef-4f19-ac1a-db69fdd210c3","Type":"ContainerStarted","Data":"6e2a85074408c0ae98c9c1a85d90c2f2401b4236fde8aee008ef69eae1f1b5e5"} Jul 06 19:06:20.695671 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.695169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" event={"ID":"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd","Type":"ContainerStarted","Data":"d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f"} Jul 06 19:06:20.695671 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.695221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:06:20.695671 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.695245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" event={"ID":"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd","Type":"ContainerStarted","Data":"d97dba07a3cf2aeb28ca47cc0def040c72349307a4167fb51bb2312767debf54"} Jul 06 19:06:20.696904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.696731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" event={"ID":"08675e57-5f60-4adc-9155-69928a3bc98f","Type":"ContainerStarted","Data":"e3003607f32b8c47c8b0517dc4abbabbc07d8a59fc1184e1cc8198820c3f7391"} Jul 06 19:06:20.698727 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.698400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" event={"ID":"d56bb270-2e88-4e18-8586-6232d36fcb69","Type":"ContainerStarted","Data":"6f85ef4af2643f45e5a7ba8f023bb59eb616f34cf3dea7394e87f6602391490c"} Jul 06 19:06:20.730114 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.730052 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" podStartSLOduration=57.730037021 podStartE2EDuration="57.730037021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:20.711795227 +0000 UTC m=+70.034530323" watchObservedRunningTime="2026-07-06 19:06:20.730037021 +0000 UTC m=+70.052772115" Jul 06 19:06:20.731006 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:20.730977 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" podStartSLOduration=69.730966368 podStartE2EDuration="1m9.730966368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:20.72975877 +0000 UTC m=+70.052493862" watchObservedRunningTime="2026-07-06 19:06:20.730966368 +0000 UTC m=+70.053701462" Jul 06 19:06:21.145067 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:21.144980 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:21.148394 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:21.148176 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:21.703607 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:21.703579 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:21.705056 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:21.705031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f65c66c8f-qrlzn" Jul 06 19:06:26.726011 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.725978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" event={"ID":"08675e57-5f60-4adc-9155-69928a3bc98f","Type":"ContainerStarted","Data":"ba0d7936756e3f7feaf09b1cc684d211429bd265a5349ccb0da93dc2df91de07"} Jul 06 19:06:26.727706 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.727677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" event={"ID":"d56bb270-2e88-4e18-8586-6232d36fcb69","Type":"ContainerStarted","Data":"633ad8bdfbc76297864c1fe2ec5afad1802680ce55b14f00938cf7dbdd0b85dc"} Jul 06 19:06:26.729890 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.729861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5g6l" event={"ID":"5911212a-ad7f-476f-8d32-c0dd65ac61ae","Type":"ContainerStarted","Data":"639c9c79e73bf4f703f6e3e916a9fc7c0922fc53cd5607f0c6eff4557f63381e"} Jul 06 19:06:26.731370 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.731346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7l5n8" event={"ID":"a1b22251-5299-42cf-9373-759be5b5ae9c","Type":"ContainerStarted","Data":"097c776048dac7c050011603c05a93f608d05b2670ccf2877cd9a6703ac50197"} Jul 06 19:06:26.733213 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.733188 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qw8z8" event={"ID":"35bf50e3-0cef-4f19-ac1a-db69fdd210c3","Type":"ContainerStarted","Data":"b919c046389172231555e1ef0a9e57752adc3f074c9376acabaf05d556a9ebfc"} Jul 06 19:06:26.733300 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.733237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qw8z8" event={"ID":"35bf50e3-0cef-4f19-ac1a-db69fdd210c3","Type":"ContainerStarted","Data":"d2a0f82fdced3816f8618abe4c457d950af8036617d9b24ce271bd5deb039b28"} Jul 06 19:06:26.733339 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.733318 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qw8z8" Jul 06 19:06:26.745371 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.745320 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nk9xl" podStartSLOduration=58.244565521 podStartE2EDuration="1m3.745303012s" totalImagesPullingTime="5.500737491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:26.745114836 +0000 UTC m=+76.067849924" watchObservedRunningTime="2026-07-06 19:06:26.745303012 +0000 UTC m=+76.068038107" Jul 06 19:06:26.759779 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.759735 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7l5n8" podStartSLOduration=67.590951319 podStartE2EDuration="1m15.759719086s" totalImagesPullingTime="8.168767767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:26.759143304 +0000 UTC m=+76.081878399" watchObservedRunningTime="2026-07-06 19:06:26.759719086 +0000 UTC m=+76.082454179" Jul 06 19:06:26.777425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.777381 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qw8z8" podStartSLOduration=34.308772134 podStartE2EDuration="39.777365581s" totalImagesPullingTime="5.468593447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:26.776304347 +0000 UTC m=+76.099039446" watchObservedRunningTime="2026-07-06 19:06:26.777365581 +0000 UTC m=+76.100100676" Jul 06 19:06:26.793762 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.793715 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5clbg" podStartSLOduration=58.228014692 podStartE2EDuration="1m3.793697911s" totalImagesPullingTime="5.565683219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:26.792513003 +0000 UTC m=+76.115248098" watchObservedRunningTime="2026-07-06 19:06:26.793697911 +0000 UTC m=+76.116433005" Jul 06 19:06:26.808929 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:26.808879 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h5g6l" podStartSLOduration=17.651202978 podStartE2EDuration="29.808859642s" totalImagesPullingTime="12.157656664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:26.808845286 +0000 UTC m=+76.131580383" watchObservedRunningTime="2026-07-06 19:06:26.808859642 +0000 UTC m=+76.131594739" Jul 06 19:06:33.337671 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:33.337555 2577 scope.go:117] "RemoveContainer" containerID="569d8282afa5499bd4e08e1b3274d2991caa092b760d74a77d088d9dcfff34f7" Jul 06 19:06:33.338110 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:06:33.337734 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-4zrmx_openshift-console-operator(4d328db8-9434-4028-b5be-112a19959976)\"" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podUID="4d328db8-9434-4028-b5be-112a19959976" Jul 06 19:06:36.738813 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:36.738786 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qw8z8" Jul 06 19:06:41.707820 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:41.707795 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:06:42.988949 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.988917 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4m8p6"] Jul 06 19:06:42.992888 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.992868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:42.995711 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.995692 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hp6cr\"" Jul 06 19:06:42.995914 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.995710 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:06:42.997004 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.996983 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:06:42.997004 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.997000 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:06:42.997225 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:42.997028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:06:43.074146 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-metrics-client-ca\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074338 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkv59\" (UniqueName: \"kubernetes.io/projected/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-kube-api-access-nkv59\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074338 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-root\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074338 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-textfile\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074500 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074500 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-tls\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074500 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-sys\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074500 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-wtmp\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.074500 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.074469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175429 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-textfile\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175429 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-tls\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-sys\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-wtmp\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175622 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-sys\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-wtmp\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175931 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175931 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-textfile\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175931 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-metrics-client-ca\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.175931 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.175896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkv59\" (UniqueName: \"kubernetes.io/projected/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-kube-api-access-nkv59\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.176372 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.176328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.176501 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.176419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-metrics-client-ca\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.176501 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.176479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-root\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.176633 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.176605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-root\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.178372 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.178348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-tls\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.178619 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.178598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.185466 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.185444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkv59\" (UniqueName: \"kubernetes.io/projected/e9ca91b1-7f30-48f7-89dc-6ba724f0299f-kube-api-access-nkv59\") pod \"node-exporter-4m8p6\" (UID: \"e9ca91b1-7f30-48f7-89dc-6ba724f0299f\") " pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.305453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.305376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m8p6" Jul 06 19:06:43.315934 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:43.315904 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ca91b1_7f30_48f7_89dc_6ba724f0299f.slice/crio-7501760a21e47237451ee2dbf6416443aee4315dbd996b9c9949cf0de99ce768 WatchSource:0}: Error finding container 7501760a21e47237451ee2dbf6416443aee4315dbd996b9c9949cf0de99ce768: Status 404 returned error can't find the container with id 7501760a21e47237451ee2dbf6416443aee4315dbd996b9c9949cf0de99ce768 Jul 06 19:06:43.797360 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:43.797324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m8p6" event={"ID":"e9ca91b1-7f30-48f7-89dc-6ba724f0299f","Type":"ContainerStarted","Data":"7501760a21e47237451ee2dbf6416443aee4315dbd996b9c9949cf0de99ce768"} Jul 06 19:06:44.802887 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:44.802855 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ca91b1-7f30-48f7-89dc-6ba724f0299f" containerID="ce98b53c2398b2a37b9ef4861b5b8cb92eba57f256766ffb93044dc3e5c6334c" exitCode=0 Jul 06 19:06:44.803215 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:44.802900 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m8p6" event={"ID":"e9ca91b1-7f30-48f7-89dc-6ba724f0299f","Type":"ContainerDied","Data":"ce98b53c2398b2a37b9ef4861b5b8cb92eba57f256766ffb93044dc3e5c6334c"} Jul 06 19:06:45.535896 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:45.535865 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b89df946-bxpkn"] Jul 06 19:06:45.808550 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:45.808467 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m8p6" event={"ID":"e9ca91b1-7f30-48f7-89dc-6ba724f0299f","Type":"ContainerStarted","Data":"4d1acbdfcc8798877798784c30abbd4b8578aea8901da48cea9d12209e136ef4"} Jul 06 19:06:45.808550 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:45.808520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m8p6" event={"ID":"e9ca91b1-7f30-48f7-89dc-6ba724f0299f","Type":"ContainerStarted","Data":"f8e6652945eddfbe1d71a9c62e3f6f41dd8711a61e2ccfeefc50ad767f0f197d"} Jul 06 19:06:45.827254 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:45.827207 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4m8p6" podStartSLOduration=2.44546055 podStartE2EDuration="3.82719147s" totalImagesPullingTime="1.317398497s" totalInitContainerRuntime="64.332423ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:45.825559789 +0000 UTC m=+95.148294899" watchObservedRunningTime="2026-07-06 19:06:45.82719147 +0000 UTC m=+95.149926565" Jul 06 19:06:48.175150 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.175112 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm"] Jul 06 19:06:48.229275 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.229242 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm"] Jul 06 19:06:48.229428 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.229354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.232292 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.232270 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:06:48.232455 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.232440 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pw2cg\"" Jul 06 19:06:48.232517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.232483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:06:48.232782 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.232760 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:06:48.232782 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.232787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:06:48.232939 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.232822 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:06:48.237704 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.237685 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:06:48.310664 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-metrics-client-ca\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310776 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-telemeter-client-tls\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310776 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310776 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310776 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-serving-certs-ca-bundle\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzllk\" (UniqueName: \"kubernetes.io/projected/f207c4ce-51c1-44a4-8761-bbb750d0440d-kube-api-access-mzllk\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-federate-client-tls\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.310938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.310837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-secret-telemeter-client\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.337505 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.337487 2577 scope.go:117] "RemoveContainer" containerID="569d8282afa5499bd4e08e1b3274d2991caa092b760d74a77d088d9dcfff34f7" Jul 06 19:06:48.411276 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-metrics-client-ca\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411396 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-telemeter-client-tls\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411481 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411568 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411568 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-serving-certs-ca-bundle\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411568 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzllk\" (UniqueName: \"kubernetes.io/projected/f207c4ce-51c1-44a4-8761-bbb750d0440d-kube-api-access-mzllk\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411723 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-federate-client-tls\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.411723 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.411639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-secret-telemeter-client\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.412159 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.412136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-metrics-client-ca\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.412336 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.412307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.412418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.412400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f207c4ce-51c1-44a4-8761-bbb750d0440d-serving-certs-ca-bundle\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.414193 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.414151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-federate-client-tls\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.414564 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.414543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.414690 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.414613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-secret-telemeter-client\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.414690 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.414676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f207c4ce-51c1-44a4-8761-bbb750d0440d-telemeter-client-tls\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.419108 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.419070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzllk\" (UniqueName: \"kubernetes.io/projected/f207c4ce-51c1-44a4-8761-bbb750d0440d-kube-api-access-mzllk\") pod \"telemeter-client-59c6d4d6b7-zzmqm\" (UID: \"f207c4ce-51c1-44a4-8761-bbb750d0440d\") " pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.538951 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.538880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" Jul 06 19:06:48.692764 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.692728 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm"] Jul 06 19:06:48.695527 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:06:48.695500 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf207c4ce_51c1_44a4_8761_bbb750d0440d.slice/crio-4af22d484b124e8cc11671c67dd3a72f58ab640c9b9d5f03d426c67c327035f8 WatchSource:0}: Error finding container 4af22d484b124e8cc11671c67dd3a72f58ab640c9b9d5f03d426c67c327035f8: Status 404 returned error can't find the container with id 4af22d484b124e8cc11671c67dd3a72f58ab640c9b9d5f03d426c67c327035f8 Jul 06 19:06:48.821562 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.821491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:06:48.821724 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.821596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" event={"ID":"4d328db8-9434-4028-b5be-112a19959976","Type":"ContainerStarted","Data":"916369c1eb228fd8d06a6c262399ad0f8e6490404df6794d6ed620e512243f9d"} Jul 06 19:06:48.821946 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.821916 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:06:48.822930 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.822906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" event={"ID":"f207c4ce-51c1-44a4-8761-bbb750d0440d","Type":"ContainerStarted","Data":"4af22d484b124e8cc11671c67dd3a72f58ab640c9b9d5f03d426c67c327035f8"} Jul 06 19:06:48.841152 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:48.841115 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" podStartSLOduration=78.314751583 podStartE2EDuration="1m25.841102784s" totalImagesPullingTime="7.526351201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:48.840671846 +0000 UTC m=+98.163406943" watchObservedRunningTime="2026-07-06 19:06:48.841102784 +0000 UTC m=+98.163837869" Jul 06 19:06:49.062131 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:49.062103 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-4zrmx" Jul 06 19:06:49.686264 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:49.686237 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vqgc5" Jul 06 19:06:51.837519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:51.837465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" event={"ID":"f207c4ce-51c1-44a4-8761-bbb750d0440d","Type":"ContainerStarted","Data":"47da82e813ecbc5b4de713f793a11a19529b0964665c35898b2839d7605e8224"} Jul 06 19:06:52.844001 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:52.843960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" event={"ID":"f207c4ce-51c1-44a4-8761-bbb750d0440d","Type":"ContainerStarted","Data":"4195572ee2d5934203994836372258ac100b8f7baef36f166d041ad07bd709ef"} Jul 06 19:06:52.844496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:52.844026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" event={"ID":"f207c4ce-51c1-44a4-8761-bbb750d0440d","Type":"ContainerStarted","Data":"ef0826a74b5af50e378003a09db10e56b285af99b02ab6f0ef8892bc9628de6d"} Jul 06 19:06:52.867053 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:06:52.866997 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59c6d4d6b7-zzmqm" podStartSLOduration=1.5749956840000001 podStartE2EDuration="4.86698175s" totalImagesPullingTime="3.291986066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:52.865816489 +0000 UTC m=+102.188551585" watchObservedRunningTime="2026-07-06 19:06:52.86698175 +0000 UTC m=+102.189716843" Jul 06 19:07:02.882015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:02.881986 2577 generic.go:356] "Generic (PLEG): container finished" podID="eb2ff725-e976-42e1-ac97-c0b0d150e281" containerID="d0a977f4d8bcd16c774bc32f96aa6fc6b4c764ee13676c667a89254cbf3e1259" exitCode=0 Jul 06 19:07:02.882415 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:02.882042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" event={"ID":"eb2ff725-e976-42e1-ac97-c0b0d150e281","Type":"ContainerDied","Data":"d0a977f4d8bcd16c774bc32f96aa6fc6b4c764ee13676c667a89254cbf3e1259"} Jul 06 19:07:02.882415 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:02.882342 2577 scope.go:117] "RemoveContainer" containerID="d0a977f4d8bcd16c774bc32f96aa6fc6b4c764ee13676c667a89254cbf3e1259" Jul 06 19:07:03.888219 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:03.888181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kmb2b" event={"ID":"eb2ff725-e976-42e1-ac97-c0b0d150e281","Type":"ContainerStarted","Data":"49122b3b89c13c38a18957a42cc3787fe01ff8dcc03176182ff03554b7a90b8c"} Jul 06 19:07:07.904671 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:07.904637 2577 generic.go:356] "Generic (PLEG): container finished" podID="42ef8e5e-4484-47ed-b090-8bf3c0d14c4e" containerID="d33a68a81fe19a1c15ffd53e203cd0056cfa348950cd38e05d07d2783a17f965" exitCode=0 Jul 06 19:07:07.905034 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:07.904693 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" event={"ID":"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e","Type":"ContainerDied","Data":"d33a68a81fe19a1c15ffd53e203cd0056cfa348950cd38e05d07d2783a17f965"} Jul 06 19:07:07.905034 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:07.904983 2577 scope.go:117] "RemoveContainer" containerID="d33a68a81fe19a1c15ffd53e203cd0056cfa348950cd38e05d07d2783a17f965" Jul 06 19:07:08.910010 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:08.909974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-v5b8s" event={"ID":"42ef8e5e-4484-47ed-b090-8bf3c0d14c4e","Type":"ContainerStarted","Data":"e227c1258f9f9debfbfd1ae332c8ea980c3030ea731de42bf10dc82dce15c66d"} Jul 06 19:07:10.556189 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.556150 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" podUID="ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" containerName="registry" containerID="cri-o://d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f" gracePeriod=30 Jul 06 19:07:10.803200 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.803172 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:07:10.881915 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.881824 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-installation-pull-secrets\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.881915 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.881870 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-image-registry-private-configuration\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.881915 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.881901 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-bound-sa-token\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.882218 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.881938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k4nh\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-kube-api-access-2k4nh\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.882218 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.881979 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-ca-trust-extracted\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.882218 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.882032 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-certificates\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.882218 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.882108 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-trusted-ca\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.882218 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.882143 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") pod \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\" (UID: \"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd\") " Jul 06 19:07:10.882731 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.882655 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:07:10.882731 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.882710 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:07:10.884988 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.884930 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:07:10.884988 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.884965 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:07:10.885209 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.885051 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:07:10.885209 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.885152 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:07:10.885209 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.885158 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-kube-api-access-2k4nh" (OuterVolumeSpecName: "kube-api-access-2k4nh") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "kube-api-access-2k4nh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:07:10.891755 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.891716 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" (UID: "ddf63e1d-d4b5-4e11-89e4-949abc9b17bd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:07:10.918895 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.918867 2577 generic.go:356] "Generic (PLEG): container finished" podID="ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" containerID="d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f" exitCode=0 Jul 06 19:07:10.919029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.918912 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" Jul 06 19:07:10.919029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.918953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" event={"ID":"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd","Type":"ContainerDied","Data":"d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f"} Jul 06 19:07:10.919029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.919007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b89df946-bxpkn" event={"ID":"ddf63e1d-d4b5-4e11-89e4-949abc9b17bd","Type":"ContainerDied","Data":"d97dba07a3cf2aeb28ca47cc0def040c72349307a4167fb51bb2312767debf54"} Jul 06 19:07:10.919029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.919027 2577 scope.go:117] "RemoveContainer" containerID="d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f" Jul 06 19:07:10.927611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.927595 2577 scope.go:117] "RemoveContainer" containerID="d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f" Jul 06 19:07:10.927868 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:07:10.927843 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f\": container with ID starting with d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f not found: ID does not exist" containerID="d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f" Jul 06 19:07:10.927918 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.927877 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f"} err="failed to get container status \"d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f\": rpc error: code = NotFound desc = could not find container \"d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f\": container with ID starting with d4309cd6dc7e1073d66ad7e95bfcfbe659232408b503d32a2fb175f790bd8d0f not found: ID does not exist" Jul 06 19:07:10.939877 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.939850 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b89df946-bxpkn"] Jul 06 19:07:10.943138 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.943117 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78b89df946-bxpkn"] Jul 06 19:07:10.983198 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983169 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-installation-pull-secrets\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983198 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983195 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-image-registry-private-configuration\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983211 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-bound-sa-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983224 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k4nh\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-kube-api-access-2k4nh\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983235 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-ca-trust-extracted\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983247 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-certificates\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983259 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-trusted-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:10.983348 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:10.983271 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd-registry-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:07:11.342528 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:11.342494 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" path="/var/lib/kubelet/pods/ddf63e1d-d4b5-4e11-89e4-949abc9b17bd/volumes" Jul 06 19:07:31.994684 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:31.994648 2577 generic.go:356] "Generic (PLEG): container finished" podID="977afa96-c2d6-4d9f-91aa-25bcba2a898a" containerID="0876e0f35dd5db62069e20950dde7742ee2e8c755a6fd77ea88d6ba3255ce325" exitCode=0 Jul 06 19:07:31.995230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:31.994724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" event={"ID":"977afa96-c2d6-4d9f-91aa-25bcba2a898a","Type":"ContainerDied","Data":"0876e0f35dd5db62069e20950dde7742ee2e8c755a6fd77ea88d6ba3255ce325"} Jul 06 19:07:31.995230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:31.995187 2577 scope.go:117] "RemoveContainer" containerID="0876e0f35dd5db62069e20950dde7742ee2e8c755a6fd77ea88d6ba3255ce325" Jul 06 19:07:32.999903 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:07:32.999871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t8kjl" event={"ID":"977afa96-c2d6-4d9f-91aa-25bcba2a898a","Type":"ContainerStarted","Data":"07766bd1e4ced60cab7f5f6df6431a09fb1ceb86ba7a6ac4a27afc8272aa3e35"} Jul 06 19:08:05.036130 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.036035 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:08:05.036517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.036362 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" containerName="registry" Jul 06 19:08:05.036517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.036379 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" containerName="registry" Jul 06 19:08:05.036517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.036432 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf63e1d-d4b5-4e11-89e4-949abc9b17bd" containerName="registry" Jul 06 19:08:05.040069 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.040052 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.042704 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.042682 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n2x6g\"" Jul 06 19:08:05.043169 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.043149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:08:05.043307 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.043257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:08:05.043420 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.043400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:08:05.044133 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.044109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:08:05.044207 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.044161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:08:05.044283 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.044265 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:08:05.044434 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.044414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:08:05.044599 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.044583 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:08:05.048770 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.048751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:08:05.052966 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.052949 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:08:05.092433 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/286810fc-7c84-4325-9664-3eb90428d31b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092531 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-config-volume\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092531 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286810fc-7c84-4325-9664-3eb90428d31b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092531 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-web-config\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286810fc-7c84-4325-9664-3eb90428d31b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/286810fc-7c84-4325-9664-3eb90428d31b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092898 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/286810fc-7c84-4325-9664-3eb90428d31b-config-out\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092898 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnd9\" (UniqueName: \"kubernetes.io/projected/286810fc-7c84-4325-9664-3eb90428d31b-kube-api-access-mnnd9\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.092898 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.092778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193257 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/286810fc-7c84-4325-9664-3eb90428d31b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193339 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-config-volume\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193339 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286810fc-7c84-4325-9664-3eb90428d31b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193339 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193339 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-web-config\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193339 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286810fc-7c84-4325-9664-3eb90428d31b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/286810fc-7c84-4325-9664-3eb90428d31b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/286810fc-7c84-4325-9664-3eb90428d31b-config-out\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnnd9\" (UniqueName: \"kubernetes.io/projected/286810fc-7c84-4325-9664-3eb90428d31b-kube-api-access-mnnd9\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.193577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.193540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.194200 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.194176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/286810fc-7c84-4325-9664-3eb90428d31b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.194398 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.194322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/286810fc-7c84-4325-9664-3eb90428d31b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.194853 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.194833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286810fc-7c84-4325-9664-3eb90428d31b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.196367 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.196326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-config-volume\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.196709 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.196666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/286810fc-7c84-4325-9664-3eb90428d31b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197040 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197380 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197540 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/286810fc-7c84-4325-9664-3eb90428d31b-config-out\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197671 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-web-config\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.197912 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.197895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/286810fc-7c84-4325-9664-3eb90428d31b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.202561 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.202539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnnd9\" (UniqueName: \"kubernetes.io/projected/286810fc-7c84-4325-9664-3eb90428d31b-kube-api-access-mnnd9\") pod \"alertmanager-main-0\" (UID: \"286810fc-7c84-4325-9664-3eb90428d31b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.350779 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.350733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:05.483594 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:05.483562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:08:05.485687 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:08:05.485657 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286810fc_7c84_4325_9664_3eb90428d31b.slice/crio-e0e5df6f0f801a330acd97271a973b34128465036ae47e7e0772cb97cb2c688f WatchSource:0}: Error finding container e0e5df6f0f801a330acd97271a973b34128465036ae47e7e0772cb97cb2c688f: Status 404 returned error can't find the container with id e0e5df6f0f801a330acd97271a973b34128465036ae47e7e0772cb97cb2c688f Jul 06 19:08:06.129846 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:06.129815 2577 generic.go:356] "Generic (PLEG): container finished" podID="286810fc-7c84-4325-9664-3eb90428d31b" containerID="5c0d3f89563dbcf580aab75a4dd2690e9bacc1f5b1cda42905d82fc5b4d42de1" exitCode=0 Jul 06 19:08:06.130234 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:06.129869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerDied","Data":"5c0d3f89563dbcf580aab75a4dd2690e9bacc1f5b1cda42905d82fc5b4d42de1"} Jul 06 19:08:06.130234 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:06.129948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"e0e5df6f0f801a330acd97271a973b34128465036ae47e7e0772cb97cb2c688f"} Jul 06 19:08:08.140150 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:08.140119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"c1f8d3923606553d25cb0cf12162dabcea273f23bc174152ac5be9b533f2f7dc"} Jul 06 19:08:08.140417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:08.140205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"bffb36300c98577286da0b29d7698216cbd0dadca0bec6c0c11f21f258044557"} Jul 06 19:08:08.140417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:08.140250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"070f8931a163a398b1df781959e6560225606759f44acefb99e254d73d6cdfaa"} Jul 06 19:08:09.146876 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:09.146841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"111c363d372b99149cdabc81657efb8a0b1e6ebdc1f8a8c17ebd18d9bb27a786"} Jul 06 19:08:09.147237 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:09.146906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"ec933268e3177983dbd2cea14ac3b23428d75f9e955a327671be3d5443fe72a5"} Jul 06 19:08:10.154840 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:10.154810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"286810fc-7c84-4325-9664-3eb90428d31b","Type":"ContainerStarted","Data":"41baa0a8e2f43b61b3d822a4afe267e37ff1c0ef86bb6d7553938ced57a46b2d"} Jul 06 19:08:10.181820 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:10.181769 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.406784362 podStartE2EDuration="5.181752285s" totalImagesPullingTime="2.755722939s" totalInitContainerRuntime="19.244984ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:10.179095591 +0000 UTC m=+179.501830678" watchObservedRunningTime="2026-07-06 19:08:10.181752285 +0000 UTC m=+179.504487378" Jul 06 19:08:43.626050 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.626016 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z"] Jul 06 19:08:43.629353 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.629336 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.631960 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.631938 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:08:43.633236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.633217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:08:43.633321 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.633221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lpf5r\"" Jul 06 19:08:43.641110 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.637464 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z"] Jul 06 19:08:43.775371 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.775330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.775371 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.775378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.775583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.775414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fbq\" (UniqueName: \"kubernetes.io/projected/bb558270-7478-4449-aad4-f25360966607-kube-api-access-p8fbq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.876207 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.876128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.876207 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.876169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.876345 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.876301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fbq\" (UniqueName: \"kubernetes.io/projected/bb558270-7478-4449-aad4-f25360966607-kube-api-access-p8fbq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.876516 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.876501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.876557 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.876537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.885217 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.885184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fbq\" (UniqueName: \"kubernetes.io/projected/bb558270-7478-4449-aad4-f25360966607-kube-api-access-p8fbq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:43.939595 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:43.939564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:08:44.064682 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:44.064655 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z"] Jul 06 19:08:44.067328 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:08:44.067299 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb558270_7478_4449_aad4_f25360966607.slice/crio-aa93bafb51950306fee964c69d321f35f35e9015a490cf33e345c76b35ee20c7 WatchSource:0}: Error finding container aa93bafb51950306fee964c69d321f35f35e9015a490cf33e345c76b35ee20c7: Status 404 returned error can't find the container with id aa93bafb51950306fee964c69d321f35f35e9015a490cf33e345c76b35ee20c7 Jul 06 19:08:44.298912 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:44.298874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" event={"ID":"bb558270-7478-4449-aad4-f25360966607","Type":"ContainerStarted","Data":"aa93bafb51950306fee964c69d321f35f35e9015a490cf33e345c76b35ee20c7"} Jul 06 19:08:54.343242 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:54.343206 2577 generic.go:356] "Generic (PLEG): container finished" podID="bb558270-7478-4449-aad4-f25360966607" containerID="73e83dccfa3a17f17e2f5a97966fcdbb09df2222a9ebf41177b075d18a68f5cd" exitCode=0 Jul 06 19:08:54.343685 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:54.343295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" event={"ID":"bb558270-7478-4449-aad4-f25360966607","Type":"ContainerDied","Data":"73e83dccfa3a17f17e2f5a97966fcdbb09df2222a9ebf41177b075d18a68f5cd"} Jul 06 19:08:56.353245 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:56.353214 2577 generic.go:356] "Generic (PLEG): container finished" podID="bb558270-7478-4449-aad4-f25360966607" containerID="51e02482ad05af63b6d905c97460f110a641232a164f1b4471bcd4432459e521" exitCode=0 Jul 06 19:08:56.353559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:08:56.353291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" event={"ID":"bb558270-7478-4449-aad4-f25360966607","Type":"ContainerDied","Data":"51e02482ad05af63b6d905c97460f110a641232a164f1b4471bcd4432459e521"} Jul 06 19:09:05.394534 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:05.394490 2577 generic.go:356] "Generic (PLEG): container finished" podID="bb558270-7478-4449-aad4-f25360966607" containerID="901c3cb9c3d338ba88596472d805c60fe54c2a5a19903f68124fc885b6f0596b" exitCode=0 Jul 06 19:09:05.394937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:05.394570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" event={"ID":"bb558270-7478-4449-aad4-f25360966607","Type":"ContainerDied","Data":"901c3cb9c3d338ba88596472d805c60fe54c2a5a19903f68124fc885b6f0596b"} Jul 06 19:09:06.524358 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.524333 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:09:06.669293 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.669262 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8fbq\" (UniqueName: \"kubernetes.io/projected/bb558270-7478-4449-aad4-f25360966607-kube-api-access-p8fbq\") pod \"bb558270-7478-4449-aad4-f25360966607\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " Jul 06 19:09:06.669455 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.669316 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-bundle\") pod \"bb558270-7478-4449-aad4-f25360966607\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " Jul 06 19:09:06.669455 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.669346 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-util\") pod \"bb558270-7478-4449-aad4-f25360966607\" (UID: \"bb558270-7478-4449-aad4-f25360966607\") " Jul 06 19:09:06.669959 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.669933 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-bundle" (OuterVolumeSpecName: "bundle") pod "bb558270-7478-4449-aad4-f25360966607" (UID: "bb558270-7478-4449-aad4-f25360966607"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:09:06.671500 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.671462 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb558270-7478-4449-aad4-f25360966607-kube-api-access-p8fbq" (OuterVolumeSpecName: "kube-api-access-p8fbq") pod "bb558270-7478-4449-aad4-f25360966607" (UID: "bb558270-7478-4449-aad4-f25360966607"). InnerVolumeSpecName "kube-api-access-p8fbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:06.673421 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.673395 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-util" (OuterVolumeSpecName: "util") pod "bb558270-7478-4449-aad4-f25360966607" (UID: "bb558270-7478-4449-aad4-f25360966607"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:09:06.770390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.770357 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8fbq\" (UniqueName: \"kubernetes.io/projected/bb558270-7478-4449-aad4-f25360966607-kube-api-access-p8fbq\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:09:06.770390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.770383 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-bundle\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:09:06.770390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:06.770393 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb558270-7478-4449-aad4-f25360966607-util\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:09:07.404642 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:07.404609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" event={"ID":"bb558270-7478-4449-aad4-f25360966607","Type":"ContainerDied","Data":"aa93bafb51950306fee964c69d321f35f35e9015a490cf33e345c76b35ee20c7"} Jul 06 19:09:07.404774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:07.404658 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa93bafb51950306fee964c69d321f35f35e9015a490cf33e345c76b35ee20c7" Jul 06 19:09:07.404774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:07.404620 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m5n6z" Jul 06 19:09:15.386447 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386413 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hcjck"] Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386716 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="util" Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386729 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="util" Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386737 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="extract" Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386743 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="extract" Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386756 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="pull" Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386761 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="pull" Jul 06 19:09:15.386910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.386805 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb558270-7478-4449-aad4-f25360966607" containerName="extract" Jul 06 19:09:15.417048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.417021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hcjck"] Jul 06 19:09:15.417208 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.417134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.419935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.419913 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 19:09:15.421164 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.421147 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zxgl4\"" Jul 06 19:09:15.421306 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.421191 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 19:09:15.437648 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.437620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwnhw\" (UniqueName: \"kubernetes.io/projected/cc974b75-9523-4768-a18e-5034a7089a75-kube-api-access-nwnhw\") pod \"cert-manager-webhook-6486ffd997-hcjck\" (UID: \"cc974b75-9523-4768-a18e-5034a7089a75\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.437742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.437659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc974b75-9523-4768-a18e-5034a7089a75-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hcjck\" (UID: \"cc974b75-9523-4768-a18e-5034a7089a75\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.538881 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.538856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwnhw\" (UniqueName: \"kubernetes.io/projected/cc974b75-9523-4768-a18e-5034a7089a75-kube-api-access-nwnhw\") pod \"cert-manager-webhook-6486ffd997-hcjck\" (UID: \"cc974b75-9523-4768-a18e-5034a7089a75\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.538985 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.538905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc974b75-9523-4768-a18e-5034a7089a75-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hcjck\" (UID: \"cc974b75-9523-4768-a18e-5034a7089a75\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.547897 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.547872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc974b75-9523-4768-a18e-5034a7089a75-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hcjck\" (UID: \"cc974b75-9523-4768-a18e-5034a7089a75\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.548100 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.548062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwnhw\" (UniqueName: \"kubernetes.io/projected/cc974b75-9523-4768-a18e-5034a7089a75-kube-api-access-nwnhw\") pod \"cert-manager-webhook-6486ffd997-hcjck\" (UID: \"cc974b75-9523-4768-a18e-5034a7089a75\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.735822 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.735791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:15.893229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:15.893207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hcjck"] Jul 06 19:09:15.895864 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:09:15.895825 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc974b75_9523_4768_a18e_5034a7089a75.slice/crio-bb45ebe6af1196a1810bb49be2b8fcf6bf5411c7830dced4e5f61909ac119341 WatchSource:0}: Error finding container bb45ebe6af1196a1810bb49be2b8fcf6bf5411c7830dced4e5f61909ac119341: Status 404 returned error can't find the container with id bb45ebe6af1196a1810bb49be2b8fcf6bf5411c7830dced4e5f61909ac119341 Jul 06 19:09:16.442470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:16.442431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" event={"ID":"cc974b75-9523-4768-a18e-5034a7089a75","Type":"ContainerStarted","Data":"bb45ebe6af1196a1810bb49be2b8fcf6bf5411c7830dced4e5f61909ac119341"} Jul 06 19:09:17.675287 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.675255 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k"] Jul 06 19:09:17.694927 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.694900 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k"] Jul 06 19:09:17.695127 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.695034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:17.697934 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.697912 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gft48\"" Jul 06 19:09:17.756042 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.756012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ce928d4-4173-40c8-9807-d1b56aedd5c7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x4p4k\" (UID: \"2ce928d4-4173-40c8-9807-d1b56aedd5c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:17.756230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.756066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjx5\" (UniqueName: \"kubernetes.io/projected/2ce928d4-4173-40c8-9807-d1b56aedd5c7-kube-api-access-djjx5\") pod \"cert-manager-cainjector-559cdd8c87-x4p4k\" (UID: \"2ce928d4-4173-40c8-9807-d1b56aedd5c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:17.857029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.856983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ce928d4-4173-40c8-9807-d1b56aedd5c7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x4p4k\" (UID: \"2ce928d4-4173-40c8-9807-d1b56aedd5c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:17.857227 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.857057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjx5\" (UniqueName: \"kubernetes.io/projected/2ce928d4-4173-40c8-9807-d1b56aedd5c7-kube-api-access-djjx5\") pod \"cert-manager-cainjector-559cdd8c87-x4p4k\" (UID: \"2ce928d4-4173-40c8-9807-d1b56aedd5c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:17.866913 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.866889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ce928d4-4173-40c8-9807-d1b56aedd5c7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-x4p4k\" (UID: \"2ce928d4-4173-40c8-9807-d1b56aedd5c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:17.867202 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:17.867182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjx5\" (UniqueName: \"kubernetes.io/projected/2ce928d4-4173-40c8-9807-d1b56aedd5c7-kube-api-access-djjx5\") pod \"cert-manager-cainjector-559cdd8c87-x4p4k\" (UID: \"2ce928d4-4173-40c8-9807-d1b56aedd5c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:18.006396 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:18.006311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" Jul 06 19:09:18.634951 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:18.634931 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k"] Jul 06 19:09:18.637262 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:09:18.637238 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ce928d4_4173_40c8_9807_d1b56aedd5c7.slice/crio-981cf3b1c60d1478c83a439bbd6a7257649623593e9f9da41e6f5fd4d555e3a6 WatchSource:0}: Error finding container 981cf3b1c60d1478c83a439bbd6a7257649623593e9f9da41e6f5fd4d555e3a6: Status 404 returned error can't find the container with id 981cf3b1c60d1478c83a439bbd6a7257649623593e9f9da41e6f5fd4d555e3a6 Jul 06 19:09:19.458640 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:19.458599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" event={"ID":"cc974b75-9523-4768-a18e-5034a7089a75","Type":"ContainerStarted","Data":"40da572486f51c2cf676e3c0008d2beb3cdabcacb8bdd212606e334190e9326e"} Jul 06 19:09:19.459121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:19.458673 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:19.460202 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:19.460179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" event={"ID":"2ce928d4-4173-40c8-9807-d1b56aedd5c7","Type":"ContainerStarted","Data":"22643c3253d0c501484bacecf8563becf83ada8a8692794e9bf0945156826b8a"} Jul 06 19:09:19.460319 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:19.460212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" event={"ID":"2ce928d4-4173-40c8-9807-d1b56aedd5c7","Type":"ContainerStarted","Data":"981cf3b1c60d1478c83a439bbd6a7257649623593e9f9da41e6f5fd4d555e3a6"} Jul 06 19:09:19.475292 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:19.475238 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" podStartSLOduration=1.842993562 podStartE2EDuration="4.475221716s" totalImagesPullingTime="2.632228154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:19.474706278 +0000 UTC m=+248.797441374" watchObservedRunningTime="2026-07-06 19:09:19.475221716 +0000 UTC m=+248.797956811" Jul 06 19:09:19.492167 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:19.492072 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-x4p4k" podStartSLOduration=2.49205642 podStartE2EDuration="2.49205642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:19.491298974 +0000 UTC m=+248.814034067" watchObservedRunningTime="2026-07-06 19:09:19.49205642 +0000 UTC m=+248.814791512" Jul 06 19:09:25.466773 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:25.466741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hcjck" Jul 06 19:09:53.202840 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.202798 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd"] Jul 06 19:09:53.205737 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.205720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.208361 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.208339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:09:53.208493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.208339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:09:53.208493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.208341 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lpf5r\"" Jul 06 19:09:53.213715 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.213694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd"] Jul 06 19:09:53.319786 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.319758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.319925 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.319800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvx8b\" (UniqueName: \"kubernetes.io/projected/57d33021-af3d-413f-86fd-6142c10805c7-kube-api-access-gvx8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.319925 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.319860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.421286 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.421261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.421428 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.421310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.421428 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.421339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvx8b\" (UniqueName: \"kubernetes.io/projected/57d33021-af3d-413f-86fd-6142c10805c7-kube-api-access-gvx8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.421703 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.421681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.421740 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.421693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.432000 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.431970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvx8b\" (UniqueName: \"kubernetes.io/projected/57d33021-af3d-413f-86fd-6142c10805c7-kube-api-access-gvx8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.516928 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.516868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:53.649260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:53.649238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd"] Jul 06 19:09:53.651678 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:09:53.651650 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d33021_af3d_413f_86fd_6142c10805c7.slice/crio-6107760cb9da2baccd9fe5c3a4ce023d17ac792078e0ebc0c8692eeb3138c234 WatchSource:0}: Error finding container 6107760cb9da2baccd9fe5c3a4ce023d17ac792078e0ebc0c8692eeb3138c234: Status 404 returned error can't find the container with id 6107760cb9da2baccd9fe5c3a4ce023d17ac792078e0ebc0c8692eeb3138c234 Jul 06 19:09:54.614496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:54.614466 2577 generic.go:356] "Generic (PLEG): container finished" podID="57d33021-af3d-413f-86fd-6142c10805c7" containerID="a882d0fa6b987677c1026e3639f1f9c9c8030ea5f13d07140b46dc5e9d528d88" exitCode=0 Jul 06 19:09:54.614947 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:54.614563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" event={"ID":"57d33021-af3d-413f-86fd-6142c10805c7","Type":"ContainerDied","Data":"a882d0fa6b987677c1026e3639f1f9c9c8030ea5f13d07140b46dc5e9d528d88"} Jul 06 19:09:54.614947 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:54.614614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" event={"ID":"57d33021-af3d-413f-86fd-6142c10805c7","Type":"ContainerStarted","Data":"6107760cb9da2baccd9fe5c3a4ce023d17ac792078e0ebc0c8692eeb3138c234"} Jul 06 19:09:55.620333 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:55.620300 2577 generic.go:356] "Generic (PLEG): container finished" podID="57d33021-af3d-413f-86fd-6142c10805c7" containerID="85478f75938a9158008de024800f2f95ea8e04f31f99ad23637276a3d06ae3b1" exitCode=0 Jul 06 19:09:55.620333 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:55.620335 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" event={"ID":"57d33021-af3d-413f-86fd-6142c10805c7","Type":"ContainerDied","Data":"85478f75938a9158008de024800f2f95ea8e04f31f99ad23637276a3d06ae3b1"} Jul 06 19:09:56.626965 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:56.626929 2577 generic.go:356] "Generic (PLEG): container finished" podID="57d33021-af3d-413f-86fd-6142c10805c7" containerID="030235242dd1ff7b5c1bc29ff5bec41fc233574c9aa3eaa244daa55d5e97709b" exitCode=0 Jul 06 19:09:56.627448 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:56.627013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" event={"ID":"57d33021-af3d-413f-86fd-6142c10805c7","Type":"ContainerDied","Data":"030235242dd1ff7b5c1bc29ff5bec41fc233574c9aa3eaa244daa55d5e97709b"} Jul 06 19:09:57.516755 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.516719 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc"] Jul 06 19:09:57.519194 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.519179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.523320 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.523293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:09:57.523532 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.523300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:57.523532 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.523304 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:09:57.523701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.523302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rqntc\"" Jul 06 19:09:57.523701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.523333 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:09:57.523701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.523396 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:09:57.529963 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.529940 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc"] Jul 06 19:09:57.654946 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.654920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9159683-6187-4008-bc26-9eac55e28969-cert\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.655355 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.654955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9159683-6187-4008-bc26-9eac55e28969-manager-config\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.655355 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.654997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9159683-6187-4008-bc26-9eac55e28969-metrics-cert\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.655355 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.655121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8zzq\" (UniqueName: \"kubernetes.io/projected/a9159683-6187-4008-bc26-9eac55e28969-kube-api-access-m8zzq\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.756315 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.756286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9159683-6187-4008-bc26-9eac55e28969-metrics-cert\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.756442 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.756340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8zzq\" (UniqueName: \"kubernetes.io/projected/a9159683-6187-4008-bc26-9eac55e28969-kube-api-access-m8zzq\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.756442 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.756392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9159683-6187-4008-bc26-9eac55e28969-cert\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.756558 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.756443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9159683-6187-4008-bc26-9eac55e28969-manager-config\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.757136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.757113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9159683-6187-4008-bc26-9eac55e28969-manager-config\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.758828 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.758809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9159683-6187-4008-bc26-9eac55e28969-metrics-cert\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.758915 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.758831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9159683-6187-4008-bc26-9eac55e28969-cert\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.761476 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.761457 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:57.764604 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.764584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8zzq\" (UniqueName: \"kubernetes.io/projected/a9159683-6187-4008-bc26-9eac55e28969-kube-api-access-m8zzq\") pod \"lws-controller-manager-7995d775b8-28lnc\" (UID: \"a9159683-6187-4008-bc26-9eac55e28969\") " pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.828773 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.828700 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:09:57.857575 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.857552 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-util\") pod \"57d33021-af3d-413f-86fd-6142c10805c7\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " Jul 06 19:09:57.857698 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.857582 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvx8b\" (UniqueName: \"kubernetes.io/projected/57d33021-af3d-413f-86fd-6142c10805c7-kube-api-access-gvx8b\") pod \"57d33021-af3d-413f-86fd-6142c10805c7\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " Jul 06 19:09:57.857698 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.857641 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-bundle\") pod \"57d33021-af3d-413f-86fd-6142c10805c7\" (UID: \"57d33021-af3d-413f-86fd-6142c10805c7\") " Jul 06 19:09:57.858386 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.858364 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-bundle" (OuterVolumeSpecName: "bundle") pod "57d33021-af3d-413f-86fd-6142c10805c7" (UID: "57d33021-af3d-413f-86fd-6142c10805c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:09:57.859709 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.859680 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d33021-af3d-413f-86fd-6142c10805c7-kube-api-access-gvx8b" (OuterVolumeSpecName: "kube-api-access-gvx8b") pod "57d33021-af3d-413f-86fd-6142c10805c7" (UID: "57d33021-af3d-413f-86fd-6142c10805c7"). InnerVolumeSpecName "kube-api-access-gvx8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:57.863466 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.863441 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-util" (OuterVolumeSpecName: "util") pod "57d33021-af3d-413f-86fd-6142c10805c7" (UID: "57d33021-af3d-413f-86fd-6142c10805c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:09:57.958309 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.958279 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-bundle\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:09:57.958309 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.958304 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d33021-af3d-413f-86fd-6142c10805c7-util\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:09:57.958309 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.958314 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvx8b\" (UniqueName: \"kubernetes.io/projected/57d33021-af3d-413f-86fd-6142c10805c7-kube-api-access-gvx8b\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:09:57.960119 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:57.960077 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc"] Jul 06 19:09:57.961968 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:09:57.961942 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9159683_6187_4008_bc26_9eac55e28969.slice/crio-aede9e7be49117113a672c3efef956bbe7226ef70d3e6e7df31afc1c4e31d340 WatchSource:0}: Error finding container aede9e7be49117113a672c3efef956bbe7226ef70d3e6e7df31afc1c4e31d340: Status 404 returned error can't find the container with id aede9e7be49117113a672c3efef956bbe7226ef70d3e6e7df31afc1c4e31d340 Jul 06 19:09:58.636901 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:58.636868 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" Jul 06 19:09:58.637071 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:58.636867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvbhxd" event={"ID":"57d33021-af3d-413f-86fd-6142c10805c7","Type":"ContainerDied","Data":"6107760cb9da2baccd9fe5c3a4ce023d17ac792078e0ebc0c8692eeb3138c234"} Jul 06 19:09:58.637071 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:58.636989 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6107760cb9da2baccd9fe5c3a4ce023d17ac792078e0ebc0c8692eeb3138c234" Jul 06 19:09:58.638072 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:09:58.638048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" event={"ID":"a9159683-6187-4008-bc26-9eac55e28969","Type":"ContainerStarted","Data":"aede9e7be49117113a672c3efef956bbe7226ef70d3e6e7df31afc1c4e31d340"} Jul 06 19:10:00.650118 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:00.650064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" event={"ID":"a9159683-6187-4008-bc26-9eac55e28969","Type":"ContainerStarted","Data":"f0a64e947210db73330bc838ceb43d6a4847fd437e6dd92e80bed86162e2ba0c"} Jul 06 19:10:00.650494 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:00.650145 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:10:00.667669 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:00.667619 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" podStartSLOduration=1.312637369 podStartE2EDuration="3.667601329s" totalImagesPullingTime="2.35496396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:00.666108518 +0000 UTC m=+289.988843611" watchObservedRunningTime="2026-07-06 19:10:00.667601329 +0000 UTC m=+289.990336423" Jul 06 19:10:11.125043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:11.125015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:10:11.132139 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:11.132107 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:10:11.132788 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:11.132763 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:10:11.137864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:11.137832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:10:11.141312 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:11.141298 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:10:11.661519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:11.661486 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7995d775b8-28lnc" Jul 06 19:10:14.332737 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.332700 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp"] Jul 06 19:10:14.333222 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333178 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="pull" Jul 06 19:10:14.333222 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333196 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="pull" Jul 06 19:10:14.333222 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333219 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="util" Jul 06 19:10:14.333390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333228 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="util" Jul 06 19:10:14.333390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333237 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="extract" Jul 06 19:10:14.333390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333246 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="extract" Jul 06 19:10:14.333390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.333338 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d33021-af3d-413f-86fd-6142c10805c7" containerName="extract" Jul 06 19:10:14.335270 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.335250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.339146 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.339124 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:10:14.339390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.339370 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:10:14.339534 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.339507 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:10:14.339641 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.339524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2b6f\"" Jul 06 19:10:14.339701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.339689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:10:14.357326 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.357297 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp"] Jul 06 19:10:14.497382 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.497344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3fec42a-1279-450c-91ea-5252d7fc8cb5-tmp\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.497382 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.497383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3fec42a-1279-450c-91ea-5252d7fc8cb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.497600 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.497464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3fec42a-1279-450c-91ea-5252d7fc8cb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.497600 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.497523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mwm\" (UniqueName: \"kubernetes.io/projected/e3fec42a-1279-450c-91ea-5252d7fc8cb5-kube-api-access-m4mwm\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.497600 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.497573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3fec42a-1279-450c-91ea-5252d7fc8cb5-manifests\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.598221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.598134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3fec42a-1279-450c-91ea-5252d7fc8cb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.598221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.598181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mwm\" (UniqueName: \"kubernetes.io/projected/e3fec42a-1279-450c-91ea-5252d7fc8cb5-kube-api-access-m4mwm\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.598221 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.598220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3fec42a-1279-450c-91ea-5252d7fc8cb5-manifests\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.598454 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.598248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3fec42a-1279-450c-91ea-5252d7fc8cb5-tmp\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.598454 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.598266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3fec42a-1279-450c-91ea-5252d7fc8cb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.598665 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.598643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3fec42a-1279-450c-91ea-5252d7fc8cb5-manifests\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.600477 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.600450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3fec42a-1279-450c-91ea-5252d7fc8cb5-tmp\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.600685 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.600669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3fec42a-1279-450c-91ea-5252d7fc8cb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.600732 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.600693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3fec42a-1279-450c-91ea-5252d7fc8cb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.610621 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.610593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mwm\" (UniqueName: \"kubernetes.io/projected/e3fec42a-1279-450c-91ea-5252d7fc8cb5-kube-api-access-m4mwm\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp\" (UID: \"e3fec42a-1279-450c-91ea-5252d7fc8cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.645453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.645422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:14.797714 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.797681 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp"] Jul 06 19:10:14.801448 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:10:14.801420 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fec42a_1279_450c_91ea_5252d7fc8cb5.slice/crio-3424d771a72150de31c02242c0575d4600e5cb910b7430258dd82bdcd4af2d37 WatchSource:0}: Error finding container 3424d771a72150de31c02242c0575d4600e5cb910b7430258dd82bdcd4af2d37: Status 404 returned error can't find the container with id 3424d771a72150de31c02242c0575d4600e5cb910b7430258dd82bdcd4af2d37 Jul 06 19:10:14.803169 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:14.803150 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:10:15.724793 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:15.724751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" event={"ID":"e3fec42a-1279-450c-91ea-5252d7fc8cb5","Type":"ContainerStarted","Data":"3424d771a72150de31c02242c0575d4600e5cb910b7430258dd82bdcd4af2d37"} Jul 06 19:10:18.741099 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:18.741052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" event={"ID":"e3fec42a-1279-450c-91ea-5252d7fc8cb5","Type":"ContainerStarted","Data":"14b1fc311b76da52cd32aa66c9fcec3477c806d500361699072a0e9265ab3bba"} Jul 06 19:10:19.747551 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:19.747511 2577 generic.go:356] "Generic (PLEG): container finished" podID="e3fec42a-1279-450c-91ea-5252d7fc8cb5" containerID="14b1fc311b76da52cd32aa66c9fcec3477c806d500361699072a0e9265ab3bba" exitCode=0 Jul 06 19:10:19.747991 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:19.747592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" event={"ID":"e3fec42a-1279-450c-91ea-5252d7fc8cb5","Type":"ContainerDied","Data":"14b1fc311b76da52cd32aa66c9fcec3477c806d500361699072a0e9265ab3bba"} Jul 06 19:10:20.760780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:20.760749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" event={"ID":"e3fec42a-1279-450c-91ea-5252d7fc8cb5","Type":"ContainerStarted","Data":"3cf1fd40be24da273de602aab5dc57d60fc9a8cc3fa8b222f25b92cd2bee64d8"} Jul 06 19:10:20.761188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:20.760895 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:20.786039 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:20.785992 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" podStartSLOduration=2.020073244 podStartE2EDuration="6.78597642s" totalImagesPullingTime="3.722464045s" totalInitContainerRuntime="1.043439131s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:20.783201036 +0000 UTC m=+310.105936131" watchObservedRunningTime="2026-07-06 19:10:20.78597642 +0000 UTC m=+310.108711515" Jul 06 19:10:31.768208 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:31.768179 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp" Jul 06 19:10:41.826511 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.826477 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq"] Jul 06 19:10:41.828903 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.828880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.832516 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.832495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:10:41.832630 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.832531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:10:41.832699 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.832498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:10:41.833252 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.833229 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:10:41.833356 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.833258 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zppv7\"" Jul 06 19:10:41.846404 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.846381 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq"] Jul 06 19:10:41.918481 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.918615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.918615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.918615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.918741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.918741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd1a43-dadc-413a-8303-6056593d5c1c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:41.918741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:41.918712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp422\" (UniqueName: \"kubernetes.io/projected/56cd1a43-dadc-413a-8303-6056593d5c1c-kube-api-access-gp422\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019342 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd1a43-dadc-413a-8303-6056593d5c1c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp422\" (UniqueName: \"kubernetes.io/projected/56cd1a43-dadc-413a-8303-6056593d5c1c-kube-api-access-gp422\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.019741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.019508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.020095 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.020055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.021628 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.021605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd1a43-dadc-413a-8303-6056593d5c1c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.021754 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.021739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.022175 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.022145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.022175 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.022167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.029907 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.029880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp422\" (UniqueName: \"kubernetes.io/projected/56cd1a43-dadc-413a-8303-6056593d5c1c-kube-api-access-gp422\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.030384 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.030366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd1a43-dadc-413a-8303-6056593d5c1c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7vvlq\" (UID: \"56cd1a43-dadc-413a-8303-6056593d5c1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.139527 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.139433 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:42.323611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.323585 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq"] Jul 06 19:10:42.325684 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:10:42.325645 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cd1a43_dadc_413a_8303_6056593d5c1c.slice/crio-af0d87dab24b8aed61ee317cd8b76e25cae7e8a77f9ec685506fe87de0939efb WatchSource:0}: Error finding container af0d87dab24b8aed61ee317cd8b76e25cae7e8a77f9ec685506fe87de0939efb: Status 404 returned error can't find the container with id af0d87dab24b8aed61ee317cd8b76e25cae7e8a77f9ec685506fe87de0939efb Jul 06 19:10:42.862358 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:42.862326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" event={"ID":"56cd1a43-dadc-413a-8303-6056593d5c1c","Type":"ContainerStarted","Data":"af0d87dab24b8aed61ee317cd8b76e25cae7e8a77f9ec685506fe87de0939efb"} Jul 06 19:10:47.080521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:47.080487 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:10:47.080791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:47.080556 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:10:47.887460 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:47.887422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" event={"ID":"56cd1a43-dadc-413a-8303-6056593d5c1c","Type":"ContainerStarted","Data":"a1670af479484c30538181010a988911a297df1cd42a35466ee16018b16379c7"} Jul 06 19:10:47.887623 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:47.887483 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:10:47.911016 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:47.910975 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" podStartSLOduration=2.158551764 podStartE2EDuration="6.910960501s" totalImagesPullingTime="4.752408737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:47.908305846 +0000 UTC m=+337.231040980" watchObservedRunningTime="2026-07-06 19:10:47.910960501 +0000 UTC m=+337.233695595" Jul 06 19:10:48.894893 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:10:48.894863 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7vvlq" Jul 06 19:11:47.119692 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.119655 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn"] Jul 06 19:11:47.122541 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.122516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.126381 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.126361 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:11:47.126709 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.126689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:11:47.127858 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.127837 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhmjg\"" Jul 06 19:11:47.137631 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.137604 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn"] Jul 06 19:11:47.246523 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.246482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s2ms\" (UniqueName: \"kubernetes.io/projected/de092c59-695f-4042-a1b1-6e6115671280-kube-api-access-6s2ms\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.246704 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.246556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.246704 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.246591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.347153 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.347120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.347318 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.347188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s2ms\" (UniqueName: \"kubernetes.io/projected/de092c59-695f-4042-a1b1-6e6115671280-kube-api-access-6s2ms\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.347318 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.347261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.347605 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.347585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.347640 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.347595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.357438 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.357409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s2ms\" (UniqueName: \"kubernetes.io/projected/de092c59-695f-4042-a1b1-6e6115671280-kube-api-access-6s2ms\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.432505 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.432478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:47.565359 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.565336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn"] Jul 06 19:11:47.569690 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:11:47.569585 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde092c59_695f_4042_a1b1_6e6115671280.slice/crio-bace204cdd5c96e32f5d6f037bf14217cf5c4be1797613c8ad3eef564fcadce7 WatchSource:0}: Error finding container bace204cdd5c96e32f5d6f037bf14217cf5c4be1797613c8ad3eef564fcadce7: Status 404 returned error can't find the container with id bace204cdd5c96e32f5d6f037bf14217cf5c4be1797613c8ad3eef564fcadce7 Jul 06 19:11:47.706223 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.706149 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg"] Jul 06 19:11:47.708866 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.708847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.720505 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.720484 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg"] Jul 06 19:11:47.750219 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.750195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.750306 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.750244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.750358 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.750307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skzw8\" (UniqueName: \"kubernetes.io/projected/20c6839b-5641-4eaf-ae88-dda01f8d6f85-kube-api-access-skzw8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.851422 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.851401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.851538 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.851450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.851538 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.851514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skzw8\" (UniqueName: \"kubernetes.io/projected/20c6839b-5641-4eaf-ae88-dda01f8d6f85-kube-api-access-skzw8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.851789 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.851770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.851848 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.851791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:47.861088 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:47.861062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skzw8\" (UniqueName: \"kubernetes.io/projected/20c6839b-5641-4eaf-ae88-dda01f8d6f85-kube-api-access-skzw8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:48.031549 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.031500 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:48.164693 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.164666 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg"] Jul 06 19:11:48.166215 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:11:48.166190 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c6839b_5641_4eaf_ae88_dda01f8d6f85.slice/crio-e941223ae114f23c9793c140e6f8f54fd2530384b74c01a5b702087c9da36a43 WatchSource:0}: Error finding container e941223ae114f23c9793c140e6f8f54fd2530384b74c01a5b702087c9da36a43: Status 404 returned error can't find the container with id e941223ae114f23c9793c140e6f8f54fd2530384b74c01a5b702087c9da36a43 Jul 06 19:11:48.172807 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.172782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" event={"ID":"20c6839b-5641-4eaf-ae88-dda01f8d6f85","Type":"ContainerStarted","Data":"e941223ae114f23c9793c140e6f8f54fd2530384b74c01a5b702087c9da36a43"} Jul 06 19:11:48.174409 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.174386 2577 generic.go:356] "Generic (PLEG): container finished" podID="de092c59-695f-4042-a1b1-6e6115671280" containerID="73ff40e6e5aafb3f971052e43de1921403f64294380e29f6d3dfa949d5799dab" exitCode=0 Jul 06 19:11:48.174502 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.174471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" event={"ID":"de092c59-695f-4042-a1b1-6e6115671280","Type":"ContainerDied","Data":"73ff40e6e5aafb3f971052e43de1921403f64294380e29f6d3dfa949d5799dab"} Jul 06 19:11:48.174566 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.174522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" event={"ID":"de092c59-695f-4042-a1b1-6e6115671280","Type":"ContainerStarted","Data":"bace204cdd5c96e32f5d6f037bf14217cf5c4be1797613c8ad3eef564fcadce7"} Jul 06 19:11:48.297877 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.297822 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m"] Jul 06 19:11:48.300544 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.300530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.312291 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.312271 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m"] Jul 06 19:11:48.355318 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.355283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.355493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.355336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jtp8\" (UniqueName: \"kubernetes.io/projected/fc0008fe-cb74-4de3-a9c0-8082bb64f408-kube-api-access-5jtp8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.355493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.355434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.456805 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.456766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.456967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.456810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jtp8\" (UniqueName: \"kubernetes.io/projected/fc0008fe-cb74-4de3-a9c0-8082bb64f408-kube-api-access-5jtp8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.456967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.456887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.457281 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.457258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.457361 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.457264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.465779 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.465756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jtp8\" (UniqueName: \"kubernetes.io/projected/fc0008fe-cb74-4de3-a9c0-8082bb64f408-kube-api-access-5jtp8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.633167 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.633045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:48.768400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.768379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m"] Jul 06 19:11:48.770549 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:11:48.770515 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0008fe_cb74_4de3_a9c0_8082bb64f408.slice/crio-d0d07cc6fd3af9c491a7daa1f09a827273ce94d3fa2449468f7c5a93e14b2b76 WatchSource:0}: Error finding container d0d07cc6fd3af9c491a7daa1f09a827273ce94d3fa2449468f7c5a93e14b2b76: Status 404 returned error can't find the container with id d0d07cc6fd3af9c491a7daa1f09a827273ce94d3fa2449468f7c5a93e14b2b76 Jul 06 19:11:48.892891 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.892816 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g"] Jul 06 19:11:48.895533 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.895513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:48.906211 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.906187 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g"] Jul 06 19:11:48.961659 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.961622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq7nr\" (UniqueName: \"kubernetes.io/projected/bc2dd636-e20d-4867-9bdb-3ad487924597-kube-api-access-gq7nr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:48.961867 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.961689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:48.961867 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:48.961770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.062704 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.062664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7nr\" (UniqueName: \"kubernetes.io/projected/bc2dd636-e20d-4867-9bdb-3ad487924597-kube-api-access-gq7nr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.062866 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.062813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.062956 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.062866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.063207 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.063186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.063307 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.063240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.072453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.072433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7nr\" (UniqueName: \"kubernetes.io/projected/bc2dd636-e20d-4867-9bdb-3ad487924597-kube-api-access-gq7nr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.180838 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.180805 2577 generic.go:356] "Generic (PLEG): container finished" podID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerID="f497e25d5abb9517bafce026eb7ef8e1528ce86ad35a2db3d6cd714a64e97325" exitCode=0 Jul 06 19:11:49.181298 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.180877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" event={"ID":"20c6839b-5641-4eaf-ae88-dda01f8d6f85","Type":"ContainerDied","Data":"f497e25d5abb9517bafce026eb7ef8e1528ce86ad35a2db3d6cd714a64e97325"} Jul 06 19:11:49.182449 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.182423 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerID="fc3232d900689f8cff30019a50363ed260e3e9fd71b6fdf3d846804a23fac8ea" exitCode=0 Jul 06 19:11:49.182559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.182511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" event={"ID":"fc0008fe-cb74-4de3-a9c0-8082bb64f408","Type":"ContainerDied","Data":"fc3232d900689f8cff30019a50363ed260e3e9fd71b6fdf3d846804a23fac8ea"} Jul 06 19:11:49.182624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.182571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" event={"ID":"fc0008fe-cb74-4de3-a9c0-8082bb64f408","Type":"ContainerStarted","Data":"d0d07cc6fd3af9c491a7daa1f09a827273ce94d3fa2449468f7c5a93e14b2b76"} Jul 06 19:11:49.221663 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.221627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:49.374271 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:49.374243 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g"] Jul 06 19:11:49.431249 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:11:49.431167 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2dd636_e20d_4867_9bdb_3ad487924597.slice/crio-12e0ec8fdee085a44f9517075fd78c86403e51b572d04d97794e92ab286a78c0 WatchSource:0}: Error finding container 12e0ec8fdee085a44f9517075fd78c86403e51b572d04d97794e92ab286a78c0: Status 404 returned error can't find the container with id 12e0ec8fdee085a44f9517075fd78c86403e51b572d04d97794e92ab286a78c0 Jul 06 19:11:50.189122 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:50.189075 2577 generic.go:356] "Generic (PLEG): container finished" podID="de092c59-695f-4042-a1b1-6e6115671280" containerID="6042cc6c27c1ad496b68e12ff2035090391992f5617e5a8328d05e53bb170b7a" exitCode=0 Jul 06 19:11:50.189477 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:50.189123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" event={"ID":"de092c59-695f-4042-a1b1-6e6115671280","Type":"ContainerDied","Data":"6042cc6c27c1ad496b68e12ff2035090391992f5617e5a8328d05e53bb170b7a"} Jul 06 19:11:50.190599 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:50.190576 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerID="38bcba1813503a200a48276d8123704f1e0b3730dbe77a5b53e240f6d77758d9" exitCode=0 Jul 06 19:11:50.190677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:50.190653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" event={"ID":"bc2dd636-e20d-4867-9bdb-3ad487924597","Type":"ContainerDied","Data":"38bcba1813503a200a48276d8123704f1e0b3730dbe77a5b53e240f6d77758d9"} Jul 06 19:11:50.190739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:50.190701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" event={"ID":"bc2dd636-e20d-4867-9bdb-3ad487924597","Type":"ContainerStarted","Data":"12e0ec8fdee085a44f9517075fd78c86403e51b572d04d97794e92ab286a78c0"} Jul 06 19:11:51.197765 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.197730 2577 generic.go:356] "Generic (PLEG): container finished" podID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerID="6c93f4991b5634139ea8c0b7ddd7dc6891a54e9f802bfa37d0a43838cec59c27" exitCode=0 Jul 06 19:11:51.198206 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.197825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" event={"ID":"20c6839b-5641-4eaf-ae88-dda01f8d6f85","Type":"ContainerDied","Data":"6c93f4991b5634139ea8c0b7ddd7dc6891a54e9f802bfa37d0a43838cec59c27"} Jul 06 19:11:51.199742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.199721 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerID="e23523b1199668ddd8e734c0e29626e52379051c63937dc5d2d8fe4a9e6820b8" exitCode=0 Jul 06 19:11:51.199828 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.199751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" event={"ID":"fc0008fe-cb74-4de3-a9c0-8082bb64f408","Type":"ContainerDied","Data":"e23523b1199668ddd8e734c0e29626e52379051c63937dc5d2d8fe4a9e6820b8"} Jul 06 19:11:51.201963 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.201942 2577 generic.go:356] "Generic (PLEG): container finished" podID="de092c59-695f-4042-a1b1-6e6115671280" containerID="5189528db62fe41371fb69c968531768209283d555136df429c52ad14843a91a" exitCode=0 Jul 06 19:11:51.202060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.202029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" event={"ID":"de092c59-695f-4042-a1b1-6e6115671280","Type":"ContainerDied","Data":"5189528db62fe41371fb69c968531768209283d555136df429c52ad14843a91a"} Jul 06 19:11:51.203946 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.203925 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerID="38e82be217035272410db8f9d3e303be4447b2572b958285104364d323208023" exitCode=0 Jul 06 19:11:51.204029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:51.203986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" event={"ID":"bc2dd636-e20d-4867-9bdb-3ad487924597","Type":"ContainerDied","Data":"38e82be217035272410db8f9d3e303be4447b2572b958285104364d323208023"} Jul 06 19:11:52.211060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.211027 2577 generic.go:356] "Generic (PLEG): container finished" podID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerID="a4c071ab513bf21ba076793d5b7a25260b915b9467757898d13b29e04c0fa6a9" exitCode=0 Jul 06 19:11:52.211508 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.211123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" event={"ID":"20c6839b-5641-4eaf-ae88-dda01f8d6f85","Type":"ContainerDied","Data":"a4c071ab513bf21ba076793d5b7a25260b915b9467757898d13b29e04c0fa6a9"} Jul 06 19:11:52.213156 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.213134 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerID="e982a630bba2d33b631dface6796c5085181e949252143efa214616597bc9fc0" exitCode=0 Jul 06 19:11:52.213284 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.213160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" event={"ID":"fc0008fe-cb74-4de3-a9c0-8082bb64f408","Type":"ContainerDied","Data":"e982a630bba2d33b631dface6796c5085181e949252143efa214616597bc9fc0"} Jul 06 19:11:52.214991 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.214967 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerID="6ef5aef94ddbaabe80ee7466ab3cefac77da5a0511cb816ff2895b59679cb734" exitCode=0 Jul 06 19:11:52.215066 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.215049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" event={"ID":"bc2dd636-e20d-4867-9bdb-3ad487924597","Type":"ContainerDied","Data":"6ef5aef94ddbaabe80ee7466ab3cefac77da5a0511cb816ff2895b59679cb734"} Jul 06 19:11:52.349337 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.349312 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:52.396900 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.396864 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-util\") pod \"de092c59-695f-4042-a1b1-6e6115671280\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " Jul 06 19:11:52.397144 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.396930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s2ms\" (UniqueName: \"kubernetes.io/projected/de092c59-695f-4042-a1b1-6e6115671280-kube-api-access-6s2ms\") pod \"de092c59-695f-4042-a1b1-6e6115671280\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " Jul 06 19:11:52.397144 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.396982 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-bundle\") pod \"de092c59-695f-4042-a1b1-6e6115671280\" (UID: \"de092c59-695f-4042-a1b1-6e6115671280\") " Jul 06 19:11:52.397493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.397469 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-bundle" (OuterVolumeSpecName: "bundle") pod "de092c59-695f-4042-a1b1-6e6115671280" (UID: "de092c59-695f-4042-a1b1-6e6115671280"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:52.399142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.399117 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de092c59-695f-4042-a1b1-6e6115671280-kube-api-access-6s2ms" (OuterVolumeSpecName: "kube-api-access-6s2ms") pod "de092c59-695f-4042-a1b1-6e6115671280" (UID: "de092c59-695f-4042-a1b1-6e6115671280"). InnerVolumeSpecName "kube-api-access-6s2ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:52.402205 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.402171 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-util" (OuterVolumeSpecName: "util") pod "de092c59-695f-4042-a1b1-6e6115671280" (UID: "de092c59-695f-4042-a1b1-6e6115671280"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:52.497884 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.497788 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-bundle\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:52.497884 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.497832 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de092c59-695f-4042-a1b1-6e6115671280-util\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:52.497884 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:52.497845 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s2ms\" (UniqueName: \"kubernetes.io/projected/de092c59-695f-4042-a1b1-6e6115671280-kube-api-access-6s2ms\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.221404 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.221374 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" Jul 06 19:11:53.221404 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.221397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn" event={"ID":"de092c59-695f-4042-a1b1-6e6115671280","Type":"ContainerDied","Data":"bace204cdd5c96e32f5d6f037bf14217cf5c4be1797613c8ad3eef564fcadce7"} Jul 06 19:11:53.221812 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.221448 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bace204cdd5c96e32f5d6f037bf14217cf5c4be1797613c8ad3eef564fcadce7" Jul 06 19:11:53.377754 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.377730 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:53.413625 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.413598 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:53.417478 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.417443 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:53.506864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.506778 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-util\") pod \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " Jul 06 19:11:53.506864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.506833 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-bundle\") pod \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " Jul 06 19:11:53.507050 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.506985 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skzw8\" (UniqueName: \"kubernetes.io/projected/20c6839b-5641-4eaf-ae88-dda01f8d6f85-kube-api-access-skzw8\") pod \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\" (UID: \"20c6839b-5641-4eaf-ae88-dda01f8d6f85\") " Jul 06 19:11:53.507050 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-bundle\") pod \"bc2dd636-e20d-4867-9bdb-3ad487924597\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " Jul 06 19:11:53.507193 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507059 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-bundle\") pod \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " Jul 06 19:11:53.507193 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507129 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq7nr\" (UniqueName: \"kubernetes.io/projected/bc2dd636-e20d-4867-9bdb-3ad487924597-kube-api-access-gq7nr\") pod \"bc2dd636-e20d-4867-9bdb-3ad487924597\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " Jul 06 19:11:53.507193 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507162 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-util\") pod \"bc2dd636-e20d-4867-9bdb-3ad487924597\" (UID: \"bc2dd636-e20d-4867-9bdb-3ad487924597\") " Jul 06 19:11:53.507354 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507209 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jtp8\" (UniqueName: \"kubernetes.io/projected/fc0008fe-cb74-4de3-a9c0-8082bb64f408-kube-api-access-5jtp8\") pod \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " Jul 06 19:11:53.507354 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507260 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-util\") pod \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\" (UID: \"fc0008fe-cb74-4de3-a9c0-8082bb64f408\") " Jul 06 19:11:53.507461 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507409 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-bundle" (OuterVolumeSpecName: "bundle") pod "20c6839b-5641-4eaf-ae88-dda01f8d6f85" (UID: "20c6839b-5641-4eaf-ae88-dda01f8d6f85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:53.507804 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507726 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-bundle" (OuterVolumeSpecName: "bundle") pod "bc2dd636-e20d-4867-9bdb-3ad487924597" (UID: "bc2dd636-e20d-4867-9bdb-3ad487924597"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:53.507956 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507753 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-bundle\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.507956 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.507821 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-bundle" (OuterVolumeSpecName: "bundle") pod "fc0008fe-cb74-4de3-a9c0-8082bb64f408" (UID: "fc0008fe-cb74-4de3-a9c0-8082bb64f408"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:53.509520 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.509396 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc2dd636-e20d-4867-9bdb-3ad487924597-kube-api-access-gq7nr" (OuterVolumeSpecName: "kube-api-access-gq7nr") pod "bc2dd636-e20d-4867-9bdb-3ad487924597" (UID: "bc2dd636-e20d-4867-9bdb-3ad487924597"). InnerVolumeSpecName "kube-api-access-gq7nr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:53.509630 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.509586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c6839b-5641-4eaf-ae88-dda01f8d6f85-kube-api-access-skzw8" (OuterVolumeSpecName: "kube-api-access-skzw8") pod "20c6839b-5641-4eaf-ae88-dda01f8d6f85" (UID: "20c6839b-5641-4eaf-ae88-dda01f8d6f85"). InnerVolumeSpecName "kube-api-access-skzw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:53.509691 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.509633 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0008fe-cb74-4de3-a9c0-8082bb64f408-kube-api-access-5jtp8" (OuterVolumeSpecName: "kube-api-access-5jtp8") pod "fc0008fe-cb74-4de3-a9c0-8082bb64f408" (UID: "fc0008fe-cb74-4de3-a9c0-8082bb64f408"). InnerVolumeSpecName "kube-api-access-5jtp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:53.513198 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.513158 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-util" (OuterVolumeSpecName: "util") pod "20c6839b-5641-4eaf-ae88-dda01f8d6f85" (UID: "20c6839b-5641-4eaf-ae88-dda01f8d6f85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:53.515682 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.515641 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-util" (OuterVolumeSpecName: "util") pod "fc0008fe-cb74-4de3-a9c0-8082bb64f408" (UID: "fc0008fe-cb74-4de3-a9c0-8082bb64f408"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:53.515857 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.515839 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-util" (OuterVolumeSpecName: "util") pod "bc2dd636-e20d-4867-9bdb-3ad487924597" (UID: "bc2dd636-e20d-4867-9bdb-3ad487924597"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:53.609220 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609188 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jtp8\" (UniqueName: \"kubernetes.io/projected/fc0008fe-cb74-4de3-a9c0-8082bb64f408-kube-api-access-5jtp8\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609220 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609219 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-util\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609233 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c6839b-5641-4eaf-ae88-dda01f8d6f85-util\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609244 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skzw8\" (UniqueName: \"kubernetes.io/projected/20c6839b-5641-4eaf-ae88-dda01f8d6f85-kube-api-access-skzw8\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609257 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-bundle\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609267 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc0008fe-cb74-4de3-a9c0-8082bb64f408-bundle\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609277 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq7nr\" (UniqueName: \"kubernetes.io/projected/bc2dd636-e20d-4867-9bdb-3ad487924597-kube-api-access-gq7nr\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:53.609430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:53.609287 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc2dd636-e20d-4867-9bdb-3ad487924597-util\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:11:54.227596 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.227553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" event={"ID":"20c6839b-5641-4eaf-ae88-dda01f8d6f85","Type":"ContainerDied","Data":"e941223ae114f23c9793c140e6f8f54fd2530384b74c01a5b702087c9da36a43"} Jul 06 19:11:54.228022 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.227639 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e941223ae114f23c9793c140e6f8f54fd2530384b74c01a5b702087c9da36a43" Jul 06 19:11:54.228022 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.227565 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg" Jul 06 19:11:54.229559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.229540 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" Jul 06 19:11:54.229689 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.229563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m" event={"ID":"fc0008fe-cb74-4de3-a9c0-8082bb64f408","Type":"ContainerDied","Data":"d0d07cc6fd3af9c491a7daa1f09a827273ce94d3fa2449468f7c5a93e14b2b76"} Jul 06 19:11:54.229689 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.229598 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d07cc6fd3af9c491a7daa1f09a827273ce94d3fa2449468f7c5a93e14b2b76" Jul 06 19:11:54.231621 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.231601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" event={"ID":"bc2dd636-e20d-4867-9bdb-3ad487924597","Type":"ContainerDied","Data":"12e0ec8fdee085a44f9517075fd78c86403e51b572d04d97794e92ab286a78c0"} Jul 06 19:11:54.231721 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.231627 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g" Jul 06 19:11:54.231721 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:11:54.231631 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12e0ec8fdee085a44f9517075fd78c86403e51b572d04d97794e92ab286a78c0" Jul 06 19:12:34.335285 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335201 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd"] Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335534 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335546 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335556 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335562 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335569 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335574 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335581 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335586 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335596 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335601 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335609 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335614 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335623 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335628 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335632 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335637 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335642 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335648 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="pull" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335659 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335663 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335672 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335677 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335684 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335688 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="util" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335737 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="20c6839b-5641-4eaf-ae88-dda01f8d6f85" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335746 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc2dd636-e20d-4867-9bdb-3ad487924597" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335752 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de092c59-695f-4042-a1b1-6e6115671280" containerName="extract" Jul 06 19:12:34.335756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.335759 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0008fe-cb74-4de3-a9c0-8082bb64f408" containerName="extract" Jul 06 19:12:34.341172 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.339370 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.344905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.344865 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:12:34.345065 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.344979 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vk52n\"" Jul 06 19:12:34.345155 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.345142 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:12:34.362468 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.362443 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd"] Jul 06 19:12:34.442294 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.442274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6rmvd\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.442397 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.442337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cws9l\" (UniqueName: \"kubernetes.io/projected/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-kube-api-access-cws9l\") pod \"kuadrant-operator-controller-manager-86878c769f-6rmvd\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.542803 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.542781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6rmvd\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.542897 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.542837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cws9l\" (UniqueName: \"kubernetes.io/projected/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-kube-api-access-cws9l\") pod \"kuadrant-operator-controller-manager-86878c769f-6rmvd\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.543158 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.543143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6rmvd\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.556905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.556881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cws9l\" (UniqueName: \"kubernetes.io/projected/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-kube-api-access-cws9l\") pod \"kuadrant-operator-controller-manager-86878c769f-6rmvd\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.651519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.651501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:34.810332 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:34.810311 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd"] Jul 06 19:12:34.812003 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:12:34.811976 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca68fa4_ec0f_4166_85e0_28a4dfa9c211.slice/crio-c0da38b1c713b09bec38e652805c322fff25799942aba630158a1eded7ea5117 WatchSource:0}: Error finding container c0da38b1c713b09bec38e652805c322fff25799942aba630158a1eded7ea5117: Status 404 returned error can't find the container with id c0da38b1c713b09bec38e652805c322fff25799942aba630158a1eded7ea5117 Jul 06 19:12:35.431268 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:35.431234 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" event={"ID":"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211","Type":"ContainerStarted","Data":"c0da38b1c713b09bec38e652805c322fff25799942aba630158a1eded7ea5117"} Jul 06 19:12:39.456756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:39.456719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" event={"ID":"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211","Type":"ContainerStarted","Data":"8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672"} Jul 06 19:12:39.457202 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:39.456829 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:12:39.496795 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:39.496754 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" podStartSLOduration=1.258795481 podStartE2EDuration="5.49674109s" totalImagesPullingTime="4.237945609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:39.49655706 +0000 UTC m=+448.819292155" watchObservedRunningTime="2026-07-06 19:12:39.49674109 +0000 UTC m=+448.819476184" Jul 06 19:12:50.464905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:12:50.464874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:15:00.098120 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.098048 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv"] Jul 06 19:15:00.101450 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.101426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.104458 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.104437 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:15:00.105678 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.105660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 19:15:00.105880 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.105860 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:15:00.105967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.105879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lqm7w\"" Jul 06 19:15:00.111556 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.111535 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv"] Jul 06 19:15:00.219337 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.219299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.219337 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.219341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.219577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.219365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.219577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.219458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw8bk\" (UniqueName: \"kubernetes.io/projected/52b5192f-1fdc-4783-bcac-729e0304d0f1-kube-api-access-qw8bk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.219577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.219495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.219577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.219520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b5192f-1fdc-4783-bcac-729e0304d0f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.320791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.320753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.320987 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.320797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.320987 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.320918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.321135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.321006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw8bk\" (UniqueName: \"kubernetes.io/projected/52b5192f-1fdc-4783-bcac-729e0304d0f1-kube-api-access-qw8bk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.321135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.321045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.321135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.321069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b5192f-1fdc-4783-bcac-729e0304d0f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.321293 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.321249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.321334 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.321289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.321420 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.321400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.323206 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.323185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52b5192f-1fdc-4783-bcac-729e0304d0f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.323465 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.323448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52b5192f-1fdc-4783-bcac-729e0304d0f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.329426 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.329403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw8bk\" (UniqueName: \"kubernetes.io/projected/52b5192f-1fdc-4783-bcac-729e0304d0f1-kube-api-access-qw8bk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n9zvv\" (UID: \"52b5192f-1fdc-4783-bcac-729e0304d0f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.414086 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.414061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:00.551175 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:00.551153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv"] Jul 06 19:15:00.553378 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:15:00.553350 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b5192f_1fdc_4783_bcac_729e0304d0f1.slice/crio-ff36fa8c7c9f0a8a3a8cc5cc6cefa1945b9067c3b49e7841824ed319372ff98e WatchSource:0}: Error finding container ff36fa8c7c9f0a8a3a8cc5cc6cefa1945b9067c3b49e7841824ed319372ff98e: Status 404 returned error can't find the container with id ff36fa8c7c9f0a8a3a8cc5cc6cefa1945b9067c3b49e7841824ed319372ff98e Jul 06 19:15:01.162491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:01.162455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" event={"ID":"52b5192f-1fdc-4783-bcac-729e0304d0f1","Type":"ContainerStarted","Data":"ff36fa8c7c9f0a8a3a8cc5cc6cefa1945b9067c3b49e7841824ed319372ff98e"} Jul 06 19:15:05.186123 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:05.186069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" event={"ID":"52b5192f-1fdc-4783-bcac-729e0304d0f1","Type":"ContainerStarted","Data":"90623a8afb17e08ff8b5aaa6524614e1c53c501efc07ac0de00a5cbda31cc9df"} Jul 06 19:15:05.204883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:05.204827 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" podStartSLOduration=1.54676769 podStartE2EDuration="5.204808377s" totalImagesPullingTime="3.658040687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:05.202640117 +0000 UTC m=+594.525375224" watchObservedRunningTime="2026-07-06 19:15:05.204808377 +0000 UTC m=+594.527543470" Jul 06 19:15:10.414514 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:10.414477 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:10.415008 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:10.414539 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:10.427399 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:10.427365 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:11.167623 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:11.167597 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:15:11.168718 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:11.168697 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:15:11.171486 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:11.171466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:15:11.172485 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:11.172466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:15:11.226141 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:11.226120 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n9zvv" Jul 06 19:15:12.583780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.583743 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs"] Jul 06 19:15:12.590818 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.590800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.593669 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.593641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 19:15:12.597734 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.597714 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs"] Jul 06 19:15:12.732659 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.732626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.732818 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.732667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.732818 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.732779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.732818 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.732810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.732944 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.732830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.732944 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.732886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q948m\" (UniqueName: \"kubernetes.io/projected/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-kube-api-access-q948m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834283 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834283 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834283 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834283 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q948m\" (UniqueName: \"kubernetes.io/projected/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-kube-api-access-q948m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834597 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834597 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834753 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834808 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.834860 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.834808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.836569 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.836550 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.836730 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.836712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.846352 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.846329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q948m\" (UniqueName: \"kubernetes.io/projected/6e2ddf47-2d85-4032-b446-c7252c9fb9d9-kube-api-access-q948m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hgsgs\" (UID: \"6e2ddf47-2d85-4032-b446-c7252c9fb9d9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:12.902901 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:12.902878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:13.039032 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:13.039005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs"] Jul 06 19:15:13.041015 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:15:13.040979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2ddf47_2d85_4032_b446_c7252c9fb9d9.slice/crio-601f0127c1b4ea13097f8bda7b9ebcd727f7ab4de69686fa1da447a73d7e0a79 WatchSource:0}: Error finding container 601f0127c1b4ea13097f8bda7b9ebcd727f7ab4de69686fa1da447a73d7e0a79: Status 404 returned error can't find the container with id 601f0127c1b4ea13097f8bda7b9ebcd727f7ab4de69686fa1da447a73d7e0a79 Jul 06 19:15:13.227565 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:13.227526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" event={"ID":"6e2ddf47-2d85-4032-b446-c7252c9fb9d9","Type":"ContainerStarted","Data":"601f0127c1b4ea13097f8bda7b9ebcd727f7ab4de69686fa1da447a73d7e0a79"} Jul 06 19:15:14.235295 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:14.235262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" event={"ID":"6e2ddf47-2d85-4032-b446-c7252c9fb9d9","Type":"ContainerStarted","Data":"a264f9e0c0b9f28b590fd7984d93a04b58f2523e7504f20e13660230092d8a73"} Jul 06 19:15:14.256938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:14.256888 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" podStartSLOduration=2.041185763 podStartE2EDuration="2.256871529s" totalImagesPullingTime="215.685766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:14.255413753 +0000 UTC m=+603.578148850" watchObservedRunningTime="2026-07-06 19:15:14.256871529 +0000 UTC m=+603.579606622" Jul 06 19:15:22.903154 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:22.903107 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:22.903602 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:22.903183 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:22.915845 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:22.915821 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:15:23.295338 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:15:23.295265 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hgsgs" Jul 06 19:20:11.203111 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:20:11.203068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:20:11.204274 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:20:11.204254 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:20:11.206653 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:20:11.206637 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:20:11.207890 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:20:11.207873 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:22:46.607966 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:46.607929 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd"] Jul 06 19:22:46.608491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:46.608187 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" podUID="6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" containerName="manager" containerID="cri-o://8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672" gracePeriod=10 Jul 06 19:22:49.466802 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.466774 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:22:49.555521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.555484 2577 generic.go:356] "Generic (PLEG): container finished" podID="6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" containerID="8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672" exitCode=0 Jul 06 19:22:49.555692 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.555532 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" Jul 06 19:22:49.555692 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.555526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" event={"ID":"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211","Type":"ContainerDied","Data":"8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672"} Jul 06 19:22:49.555692 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.555652 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd" event={"ID":"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211","Type":"ContainerDied","Data":"c0da38b1c713b09bec38e652805c322fff25799942aba630158a1eded7ea5117"} Jul 06 19:22:49.555692 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.555675 2577 scope.go:117] "RemoveContainer" containerID="8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672" Jul 06 19:22:49.565236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.565218 2577 scope.go:117] "RemoveContainer" containerID="8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672" Jul 06 19:22:49.565503 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:22:49.565485 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672\": container with ID starting with 8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672 not found: ID does not exist" containerID="8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672" Jul 06 19:22:49.565568 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.565518 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672"} err="failed to get container status \"8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672\": rpc error: code = NotFound desc = could not find container \"8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672\": container with ID starting with 8698f4108b8c2003805e9dc4139b1e593f4899d37973ec9007131d528fef9672 not found: ID does not exist" Jul 06 19:22:49.578842 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.578790 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-extensions-socket-volume\") pod \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " Jul 06 19:22:49.578943 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.578928 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cws9l\" (UniqueName: \"kubernetes.io/projected/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-kube-api-access-cws9l\") pod \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\" (UID: \"6ca68fa4-ec0f-4166-85e0-28a4dfa9c211\") " Jul 06 19:22:49.579226 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.579200 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" (UID: "6ca68fa4-ec0f-4166-85e0-28a4dfa9c211"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:22:49.580878 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.580851 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-kube-api-access-cws9l" (OuterVolumeSpecName: "kube-api-access-cws9l") pod "6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" (UID: "6ca68fa4-ec0f-4166-85e0-28a4dfa9c211"). InnerVolumeSpecName "kube-api-access-cws9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:22:49.679811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.679762 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-extensions-socket-volume\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:22:49.679811 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.679807 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cws9l\" (UniqueName: \"kubernetes.io/projected/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211-kube-api-access-cws9l\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:22:49.878733 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.878706 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd"] Jul 06 19:22:49.884708 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:49.884682 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6rmvd"] Jul 06 19:22:51.347414 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:22:51.347383 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" path="/var/lib/kubelet/pods/6ca68fa4-ec0f-4166-85e0-28a4dfa9c211/volumes" Jul 06 19:23:47.817155 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.817123 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5"] Jul 06 19:23:47.817735 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.817620 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" containerName="manager" Jul 06 19:23:47.817735 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.817640 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" containerName="manager" Jul 06 19:23:47.817854 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.817759 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ca68fa4-ec0f-4166-85e0-28a4dfa9c211" containerName="manager" Jul 06 19:23:47.820707 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.820670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:47.823647 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.823624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vk52n\"" Jul 06 19:23:47.823738 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.823632 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:23:47.823738 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.823694 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:23:47.831677 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.831656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5"] Jul 06 19:23:47.852511 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.852488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/589cee41-8282-44ef-a670-88140ca2fa62-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8bxq5\" (UID: \"589cee41-8282-44ef-a670-88140ca2fa62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:47.852608 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.852529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjsw\" (UniqueName: \"kubernetes.io/projected/589cee41-8282-44ef-a670-88140ca2fa62-kube-api-access-5gjsw\") pod \"kuadrant-operator-controller-manager-86878c769f-8bxq5\" (UID: \"589cee41-8282-44ef-a670-88140ca2fa62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:47.953813 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.953787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/589cee41-8282-44ef-a670-88140ca2fa62-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8bxq5\" (UID: \"589cee41-8282-44ef-a670-88140ca2fa62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:47.953905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.953823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjsw\" (UniqueName: \"kubernetes.io/projected/589cee41-8282-44ef-a670-88140ca2fa62-kube-api-access-5gjsw\") pod \"kuadrant-operator-controller-manager-86878c769f-8bxq5\" (UID: \"589cee41-8282-44ef-a670-88140ca2fa62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:47.954161 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.954142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/589cee41-8282-44ef-a670-88140ca2fa62-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8bxq5\" (UID: \"589cee41-8282-44ef-a670-88140ca2fa62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:47.962228 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:47.962209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjsw\" (UniqueName: \"kubernetes.io/projected/589cee41-8282-44ef-a670-88140ca2fa62-kube-api-access-5gjsw\") pod \"kuadrant-operator-controller-manager-86878c769f-8bxq5\" (UID: \"589cee41-8282-44ef-a670-88140ca2fa62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:48.130968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:48.130905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:48.270308 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:48.270284 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5"] Jul 06 19:23:48.272210 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:23:48.272178 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589cee41_8282_44ef_a670_88140ca2fa62.slice/crio-ef4c898e5205e58f90547da5982fc221c7705dcb40df341358f96c54a99ebe13 WatchSource:0}: Error finding container ef4c898e5205e58f90547da5982fc221c7705dcb40df341358f96c54a99ebe13: Status 404 returned error can't find the container with id ef4c898e5205e58f90547da5982fc221c7705dcb40df341358f96c54a99ebe13 Jul 06 19:23:48.850907 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:48.850872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" event={"ID":"589cee41-8282-44ef-a670-88140ca2fa62","Type":"ContainerStarted","Data":"481096dc40d39bc61322495c98abffe2cef88ba7ce58a41b01ec075573e844c9"} Jul 06 19:23:48.851327 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:48.850927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" event={"ID":"589cee41-8282-44ef-a670-88140ca2fa62","Type":"ContainerStarted","Data":"ef4c898e5205e58f90547da5982fc221c7705dcb40df341358f96c54a99ebe13"} Jul 06 19:23:48.851327 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:48.850965 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:23:48.874036 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:48.873988 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" podStartSLOduration=1.873973233 podStartE2EDuration="1.873973233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:48.871246249 +0000 UTC m=+1118.193981343" watchObservedRunningTime="2026-07-06 19:23:48.873973233 +0000 UTC m=+1118.196708326" Jul 06 19:23:59.857826 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:23:59.857798 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8bxq5" Jul 06 19:25:11.239645 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:25:11.239612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:25:11.244609 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:25:11.244584 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:25:11.246139 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:25:11.246115 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:25:11.248377 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:25:11.248360 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:30:11.277709 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:30:11.277680 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:30:11.280599 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:30:11.280578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:30:11.281538 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:30:11.281517 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:30:11.284220 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:30:11.284201 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:31:01.078406 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.078371 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2"] Jul 06 19:31:01.082591 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.082570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.085385 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.085361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f8415d16-serving-cert\"" Jul 06 19:31:01.085385 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.085384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:31:01.178933 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.178899 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2"] Jul 06 19:31:01.194456 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.194424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.194613 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.194495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf874\" (UniqueName: \"kubernetes.io/projected/cf6016d9-b0cd-4004-bf51-d674fb29f0df-kube-api-access-vf874\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.194613 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.194579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6016d9-b0cd-4004-bf51-d674fb29f0df-openshift-service-ca\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.295983 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.295941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf874\" (UniqueName: \"kubernetes.io/projected/cf6016d9-b0cd-4004-bf51-d674fb29f0df-kube-api-access-vf874\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.296199 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.296018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6016d9-b0cd-4004-bf51-d674fb29f0df-openshift-service-ca\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.296199 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.296076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.296288 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:01.296249 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-f8415d16-serving-cert: secret "maas-api-e2e-ait-f8415d16-serving-cert" not found Jul 06 19:31:01.296342 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:01.296331 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls podName:cf6016d9-b0cd-4004-bf51-d674fb29f0df nodeName:}" failed. No retries permitted until 2026-07-06 19:31:01.796309368 +0000 UTC m=+1551.119044444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls") pod "maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" (UID: "cf6016d9-b0cd-4004-bf51-d674fb29f0df") : secret "maas-api-e2e-ait-f8415d16-serving-cert" not found Jul 06 19:31:01.296710 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.296691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6016d9-b0cd-4004-bf51-d674fb29f0df-openshift-service-ca\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.307418 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.307393 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf874\" (UniqueName: \"kubernetes.io/projected/cf6016d9-b0cd-4004-bf51-d674fb29f0df-kube-api-access-vf874\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.800367 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.800326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.802741 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.802712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls\") pod \"maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:01.995453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:01.995417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:02.133788 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:02.133764 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2"] Jul 06 19:31:02.136781 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:31:02.136753 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6016d9_b0cd_4004_bf51_d674fb29f0df.slice/crio-ec38c749630901be2c8b9929553a5b99344a9763b24b375bc4a841c7e051f13b WatchSource:0}: Error finding container ec38c749630901be2c8b9929553a5b99344a9763b24b375bc4a841c7e051f13b: Status 404 returned error can't find the container with id ec38c749630901be2c8b9929553a5b99344a9763b24b375bc4a841c7e051f13b Jul 06 19:31:02.138271 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:02.138255 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:31:03.108630 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:03.108588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" event={"ID":"cf6016d9-b0cd-4004-bf51-d674fb29f0df","Type":"ContainerStarted","Data":"ec38c749630901be2c8b9929553a5b99344a9763b24b375bc4a841c7e051f13b"} Jul 06 19:31:05.122160 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:05.122123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" event={"ID":"cf6016d9-b0cd-4004-bf51-d674fb29f0df","Type":"ContainerStarted","Data":"4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf"} Jul 06 19:31:05.122636 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:05.122248 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:05.142393 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:05.142351 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" podStartSLOduration=2.152033158 podStartE2EDuration="4.142337576s" totalImagesPullingTime="1.990304418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:05.140690699 +0000 UTC m=+1554.463425795" watchObservedRunningTime="2026-07-06 19:31:05.142337576 +0000 UTC m=+1554.465072735" Jul 06 19:31:09.165710 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.165677 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2"] Jul 06 19:31:09.168152 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.165906 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" podUID="cf6016d9-b0cd-4004-bf51-d674fb29f0df" containerName="maas-api" containerID="cri-o://4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf" gracePeriod=30 Jul 06 19:31:09.171144 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.171124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:09.418541 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.418487 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:09.568632 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.568604 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6016d9-b0cd-4004-bf51-d674fb29f0df-openshift-service-ca\") pod \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " Jul 06 19:31:09.568632 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.568639 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf874\" (UniqueName: \"kubernetes.io/projected/cf6016d9-b0cd-4004-bf51-d674fb29f0df-kube-api-access-vf874\") pod \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " Jul 06 19:31:09.568867 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.568844 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls\") pod \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\" (UID: \"cf6016d9-b0cd-4004-bf51-d674fb29f0df\") " Jul 06 19:31:09.568979 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.568957 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6016d9-b0cd-4004-bf51-d674fb29f0df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf6016d9-b0cd-4004-bf51-d674fb29f0df" (UID: "cf6016d9-b0cd-4004-bf51-d674fb29f0df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:31:09.569169 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.569149 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6016d9-b0cd-4004-bf51-d674fb29f0df-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:09.570848 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.570823 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6016d9-b0cd-4004-bf51-d674fb29f0df-kube-api-access-vf874" (OuterVolumeSpecName: "kube-api-access-vf874") pod "cf6016d9-b0cd-4004-bf51-d674fb29f0df" (UID: "cf6016d9-b0cd-4004-bf51-d674fb29f0df"). InnerVolumeSpecName "kube-api-access-vf874". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:09.570939 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.570832 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf6016d9-b0cd-4004-bf51-d674fb29f0df" (UID: "cf6016d9-b0cd-4004-bf51-d674fb29f0df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:09.670551 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.670495 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6016d9-b0cd-4004-bf51-d674fb29f0df-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:09.670551 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:09.670519 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf874\" (UniqueName: \"kubernetes.io/projected/cf6016d9-b0cd-4004-bf51-d674fb29f0df-kube-api-access-vf874\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:10.151414 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.151378 2577 generic.go:356] "Generic (PLEG): container finished" podID="cf6016d9-b0cd-4004-bf51-d674fb29f0df" containerID="4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf" exitCode=0 Jul 06 19:31:10.151617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.151445 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" Jul 06 19:31:10.151617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.151460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" event={"ID":"cf6016d9-b0cd-4004-bf51-d674fb29f0df","Type":"ContainerDied","Data":"4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf"} Jul 06 19:31:10.151617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.151539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2" event={"ID":"cf6016d9-b0cd-4004-bf51-d674fb29f0df","Type":"ContainerDied","Data":"ec38c749630901be2c8b9929553a5b99344a9763b24b375bc4a841c7e051f13b"} Jul 06 19:31:10.151617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.151563 2577 scope.go:117] "RemoveContainer" containerID="4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf" Jul 06 19:31:10.161519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.161502 2577 scope.go:117] "RemoveContainer" containerID="4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf" Jul 06 19:31:10.161778 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:10.161759 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf\": container with ID starting with 4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf not found: ID does not exist" containerID="4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf" Jul 06 19:31:10.161834 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.161787 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf"} err="failed to get container status \"4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf\": rpc error: code = NotFound desc = could not find container \"4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf\": container with ID starting with 4c6b64bec72c136ba17e44300629a3bac46ff9a091462393675716f30fbc4fbf not found: ID does not exist" Jul 06 19:31:10.174062 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.174040 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2"] Jul 06 19:31:10.177465 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:10.177445 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f8415d16-569fdfd4c7-fnzc2"] Jul 06 19:31:11.343618 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:11.343593 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6016d9-b0cd-4004-bf51-d674fb29f0df" path="/var/lib/kubelet/pods/cf6016d9-b0cd-4004-bf51-d674fb29f0df/volumes" Jul 06 19:31:21.139751 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.139713 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79"] Jul 06 19:31:21.140256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.140241 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6016d9-b0cd-4004-bf51-d674fb29f0df" containerName="maas-api" Jul 06 19:31:21.140256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.140256 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6016d9-b0cd-4004-bf51-d674fb29f0df" containerName="maas-api" Jul 06 19:31:21.140332 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.140315 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6016d9-b0cd-4004-bf51-d674fb29f0df" containerName="maas-api" Jul 06 19:31:21.144505 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.144480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.147534 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.147512 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2fcd6471-openshift-default-dockercfg-s6c8d\"" Jul 06 19:31:21.150468 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxskn\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-kube-api-access-vxskn\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-credential-socket\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-certs\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-token\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150715 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-data\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150715 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-socket\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150715 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-envoy\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150715 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a50c02-9c82-488a-8183-375d8b7e4f9a-istiod-ca-cert\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.150715 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.150678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-podinfo\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.156479 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.156445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79"] Jul 06 19:31:21.251266 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-podinfo\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxskn\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-kube-api-access-vxskn\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-credential-socket\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-certs\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-token\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-data\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-socket\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251781 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-envoy\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251781 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a50c02-9c82-488a-8183-375d8b7e4f9a-istiod-ca-cert\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-certs\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-socket\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.251974 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.251938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-data\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.252106 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.252057 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-credential-socket\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.252320 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.252302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a50c02-9c82-488a-8183-375d8b7e4f9a-istiod-ca-cert\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.253728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.253708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-envoy\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.253965 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.253946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-podinfo\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.259709 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.259685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxskn\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-kube-api-access-vxskn\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.259806 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.259695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-token\") pod \"e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.455465 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.455434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:21.602807 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:21.602776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79"] Jul 06 19:31:21.603587 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:31:21.603563 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a50c02_9c82_488a_8183_375d8b7e4f9a.slice/crio-4309e4552f90bd3eb870db64c62e3b2bf133441841e29d3503110763e336d219 WatchSource:0}: Error finding container 4309e4552f90bd3eb870db64c62e3b2bf133441841e29d3503110763e336d219: Status 404 returned error can't find the container with id 4309e4552f90bd3eb870db64c62e3b2bf133441841e29d3503110763e336d219 Jul 06 19:31:22.216442 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.216405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" event={"ID":"51a50c02-9c82-488a-8183-375d8b7e4f9a","Type":"ContainerStarted","Data":"4309e4552f90bd3eb870db64c62e3b2bf133441841e29d3503110763e336d219"} Jul 06 19:31:22.348415 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.347981 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt"] Jul 06 19:31:22.352522 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.352492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.357386 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.357269 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:31:22.357568 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.357458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-2fcd6471-serving-cert\"" Jul 06 19:31:22.361872 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.361635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.361872 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.361685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-openshift-service-ca\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.361872 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.361785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbxks\" (UniqueName: \"kubernetes.io/projected/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-kube-api-access-pbxks\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.366103 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.366027 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt"] Jul 06 19:31:22.462309 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.462243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-openshift-service-ca\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.462499 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.462355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbxks\" (UniqueName: \"kubernetes.io/projected/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-kube-api-access-pbxks\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.462499 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.462429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.462623 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:22.462561 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-2fcd6471-serving-cert: secret "maas-api-e2e-derive-2fcd6471-serving-cert" not found Jul 06 19:31:22.462956 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:22.462728 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls podName:c14ca7ed-3b19-47aa-b93c-4cfb188edfb8 nodeName:}" failed. No retries permitted until 2026-07-06 19:31:22.962704356 +0000 UTC m=+1572.285439434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls") pod "maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" (UID: "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8") : secret "maas-api-e2e-derive-2fcd6471-serving-cert" not found Jul 06 19:31:22.463188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.463160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-openshift-service-ca\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.473689 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.473627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbxks\" (UniqueName: \"kubernetes.io/projected/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-kube-api-access-pbxks\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.968582 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.968544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:22.971408 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:22.971376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls\") pod \"maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:23.269804 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:23.269725 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:24.074649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.074612 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:31:24.074757 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.074682 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:31:24.074757 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.074714 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:31:24.148406 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.148383 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt"] Jul 06 19:31:24.149502 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:31:24.149472 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14ca7ed_3b19_47aa_b93c_4cfb188edfb8.slice/crio-467c14389087bb1507d8f17a3d2fabdd224fcd49a5a45fa275c46cf5b7c02401 WatchSource:0}: Error finding container 467c14389087bb1507d8f17a3d2fabdd224fcd49a5a45fa275c46cf5b7c02401: Status 404 returned error can't find the container with id 467c14389087bb1507d8f17a3d2fabdd224fcd49a5a45fa275c46cf5b7c02401 Jul 06 19:31:24.233797 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.233754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" event={"ID":"51a50c02-9c82-488a-8183-375d8b7e4f9a","Type":"ContainerStarted","Data":"ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42"} Jul 06 19:31:24.235144 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.235117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" event={"ID":"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8","Type":"ContainerStarted","Data":"467c14389087bb1507d8f17a3d2fabdd224fcd49a5a45fa275c46cf5b7c02401"} Jul 06 19:31:24.253113 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.253051 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" podStartSLOduration=0.784477601 podStartE2EDuration="3.253030819s" totalImagesPullingTime="2.468553218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:24.251025932 +0000 UTC m=+1573.573761027" watchObservedRunningTime="2026-07-06 19:31:24.253030819 +0000 UTC m=+1573.575765912" Jul 06 19:31:24.456248 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:24.456222 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:25.247354 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:25.247304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" event={"ID":"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8","Type":"ContainerStarted","Data":"7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2"} Jul 06 19:31:25.247549 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:25.247413 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:25.265780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:25.265730 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" podStartSLOduration=2.9270205259999997 podStartE2EDuration="3.265713674s" totalImagesPullingTime="338.693148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:25.263561958 +0000 UTC m=+1574.586297053" watchObservedRunningTime="2026-07-06 19:31:25.265713674 +0000 UTC m=+1574.588448767" Jul 06 19:31:25.461511 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:25.461480 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:26.252377 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:26.252344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:26.253306 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:26.253286 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:29.698145 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:29.698114 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt"] Jul 06 19:31:29.698593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:29.698329 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" podUID="c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" containerName="maas-api" containerID="cri-o://7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2" gracePeriod=30 Jul 06 19:31:29.703659 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:29.703633 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:29.865568 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:29.865533 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79"] Jul 06 19:31:29.865756 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:29.865732 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" podUID="51a50c02-9c82-488a-8183-375d8b7e4f9a" containerName="istio-proxy" containerID="cri-o://ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42" gracePeriod=30 Jul 06 19:31:29.963134 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:29.963067 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:30.037759 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.037732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-openshift-service-ca\") pod \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " Jul 06 19:31:30.037899 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.037841 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbxks\" (UniqueName: \"kubernetes.io/projected/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-kube-api-access-pbxks\") pod \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " Jul 06 19:31:30.037899 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.037873 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls\") pod \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\" (UID: \"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8\") " Jul 06 19:31:30.038175 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.038150 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" (UID: "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:31:30.039980 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.039952 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" (UID: "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:30.040111 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.040027 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-kube-api-access-pbxks" (OuterVolumeSpecName: "kube-api-access-pbxks") pod "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" (UID: "c14ca7ed-3b19-47aa-b93c-4cfb188edfb8"). InnerVolumeSpecName "kube-api-access-pbxks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:30.138836 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.138800 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbxks\" (UniqueName: \"kubernetes.io/projected/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-kube-api-access-pbxks\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:30.138836 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.138832 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:30.138836 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.138841 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:30.275427 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.275336 2577 generic.go:356] "Generic (PLEG): container finished" podID="c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" containerID="7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2" exitCode=0 Jul 06 19:31:30.275427 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.275392 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" Jul 06 19:31:30.275427 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.275416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" event={"ID":"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8","Type":"ContainerDied","Data":"7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2"} Jul 06 19:31:30.275647 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.275465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt" event={"ID":"c14ca7ed-3b19-47aa-b93c-4cfb188edfb8","Type":"ContainerDied","Data":"467c14389087bb1507d8f17a3d2fabdd224fcd49a5a45fa275c46cf5b7c02401"} Jul 06 19:31:30.275647 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.275486 2577 scope.go:117] "RemoveContainer" containerID="7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2" Jul 06 19:31:30.291865 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.291845 2577 scope.go:117] "RemoveContainer" containerID="7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2" Jul 06 19:31:30.292155 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:30.292134 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2\": container with ID starting with 7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2 not found: ID does not exist" containerID="7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2" Jul 06 19:31:30.292212 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.292164 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2"} err="failed to get container status \"7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2\": rpc error: code = NotFound desc = could not find container \"7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2\": container with ID starting with 7aa9f3a483c22872d33ccfe95f699a0a3e5af5ac73eb4a31d5f49b6191c1b0b2 not found: ID does not exist" Jul 06 19:31:30.303340 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.303316 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt"] Jul 06 19:31:30.307660 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:30.307631 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-2fcd6471-796d8dfd56-grdgt"] Jul 06 19:31:31.344863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:31.344831 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" path="/var/lib/kubelet/pods/c14ca7ed-3b19-47aa-b93c-4cfb188edfb8/volumes" Jul 06 19:31:35.116332 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.116307 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:35.187183 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187159 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-envoy\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187310 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187222 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-credential-socket\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187310 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187241 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-certs\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187413 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187258 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-data\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187413 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187366 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-socket\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187423 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxskn\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-kube-api-access-vxskn\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a50c02-9c82-488a-8183-375d8b7e4f9a-istiod-ca-cert\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187492 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-token\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187664 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187550 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-podinfo\") pod \"51a50c02-9c82-488a-8183-375d8b7e4f9a\" (UID: \"51a50c02-9c82-488a-8183-375d8b7e4f9a\") " Jul 06 19:31:35.187664 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187562 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.187664 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187601 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.187922 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187865 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.187922 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187891 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.187922 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187871 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a50c02-9c82-488a-8183-375d8b7e4f9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:31:35.187922 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.187888 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.188194 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.188111 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.189604 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.189583 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.189702 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.189586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:31:35.189745 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.189731 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:35.189783 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.189740 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-kube-api-access-vxskn" (OuterVolumeSpecName: "kube-api-access-vxskn") pod "51a50c02-9c82-488a-8183-375d8b7e4f9a" (UID: "51a50c02-9c82-488a-8183-375d8b7e4f9a"). InnerVolumeSpecName "kube-api-access-vxskn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:35.289021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.288997 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.289021 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.289019 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.289173 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.289028 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a50c02-9c82-488a-8183-375d8b7e4f9a-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.289173 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.289037 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxskn\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-kube-api-access-vxskn\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.289173 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.289048 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a50c02-9c82-488a-8183-375d8b7e4f9a-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.289173 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.289056 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.289173 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.289063 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a50c02-9c82-488a-8183-375d8b7e4f9a-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.302325 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.302301 2577 generic.go:356] "Generic (PLEG): container finished" podID="51a50c02-9c82-488a-8183-375d8b7e4f9a" containerID="ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42" exitCode=0 Jul 06 19:31:35.302417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.302347 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" Jul 06 19:31:35.302417 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.302388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" event={"ID":"51a50c02-9c82-488a-8183-375d8b7e4f9a","Type":"ContainerDied","Data":"ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42"} Jul 06 19:31:35.302484 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.302446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79" event={"ID":"51a50c02-9c82-488a-8183-375d8b7e4f9a","Type":"ContainerDied","Data":"4309e4552f90bd3eb870db64c62e3b2bf133441841e29d3503110763e336d219"} Jul 06 19:31:35.302484 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.302469 2577 scope.go:117] "RemoveContainer" containerID="ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42" Jul 06 19:31:35.312010 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.311996 2577 scope.go:117] "RemoveContainer" containerID="ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42" Jul 06 19:31:35.312262 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:31:35.312247 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42\": container with ID starting with ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42 not found: ID does not exist" containerID="ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42" Jul 06 19:31:35.312302 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.312269 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42"} err="failed to get container status \"ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42\": rpc error: code = NotFound desc = could not find container \"ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42\": container with ID starting with ceb9075a6916839181746037a82be2e5bc4c4121465944408ca379250407ee42 not found: ID does not exist" Jul 06 19:31:35.325149 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.325127 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79"] Jul 06 19:31:35.328685 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.328666 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2fcd6471-openshift-default-f8dbd7667-6ff79"] Jul 06 19:31:35.342689 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:31:35.342666 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a50c02-9c82-488a-8183-375d8b7e4f9a" path="/var/lib/kubelet/pods/51a50c02-9c82-488a-8183-375d8b7e4f9a/volumes" Jul 06 19:33:11.232409 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232370 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m"] Jul 06 19:33:11.232904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232843 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a50c02-9c82-488a-8183-375d8b7e4f9a" containerName="istio-proxy" Jul 06 19:33:11.232904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232857 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a50c02-9c82-488a-8183-375d8b7e4f9a" containerName="istio-proxy" Jul 06 19:33:11.232904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232880 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" containerName="maas-api" Jul 06 19:33:11.232904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232886 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" containerName="maas-api" Jul 06 19:33:11.233040 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232944 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ca7ed-3b19-47aa-b93c-4cfb188edfb8" containerName="maas-api" Jul 06 19:33:11.233040 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.232954 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a50c02-9c82-488a-8183-375d8b7e4f9a" containerName="istio-proxy" Jul 06 19:33:11.235927 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.235911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.238872 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.238852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-deaeb94f-openshift-default-dockercfg-vkc4s\"" Jul 06 19:33:11.254285 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.254263 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m"] Jul 06 19:33:11.298864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.298834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istiod-ca-cert\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.298988 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.298873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47cd\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-kube-api-access-v47cd\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.298988 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.298895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-socket\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.298988 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.298911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-token\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.299158 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.299019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-certs\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.299158 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.299136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-data\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.299239 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.299176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-envoy\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.299239 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.299226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-credential-socket\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.299327 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.299255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-podinfo\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400361 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-socket\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400361 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-token\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-certs\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-data\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-envoy\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-credential-socket\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-podinfo\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istiod-ca-cert\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400611 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47cd\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-kube-api-access-v47cd\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.400965 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-certs\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.401026 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.400978 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-socket\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.401069 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.401023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-data\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.401138 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.401124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-credential-socket\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.401322 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.401300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istiod-ca-cert\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.402884 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.402863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-envoy\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.403236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.403216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-podinfo\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.410301 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.410276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-token\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.410453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.410431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47cd\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-kube-api-access-v47cd\") pod \"e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.546783 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.546706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:11.687260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.687231 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m"] Jul 06 19:33:11.687876 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:33:11.687851 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c61e70_f87c_4c24_b8f2_5911181bbfa7.slice/crio-c23fb7806ae9695bd6fb5ea4e4e470f9a782a480f5a919645fac26f4c2f88055 WatchSource:0}: Error finding container c23fb7806ae9695bd6fb5ea4e4e470f9a782a480f5a919645fac26f4c2f88055: Status 404 returned error can't find the container with id c23fb7806ae9695bd6fb5ea4e4e470f9a782a480f5a919645fac26f4c2f88055 Jul 06 19:33:11.690100 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.690048 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:11.690185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.690129 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:11.690185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.690159 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:11.795319 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.795280 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" event={"ID":"e7c61e70-f87c-4c24-b8f2-5911181bbfa7","Type":"ContainerStarted","Data":"ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0"} Jul 06 19:33:11.795496 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.795349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" event={"ID":"e7c61e70-f87c-4c24-b8f2-5911181bbfa7","Type":"ContainerStarted","Data":"c23fb7806ae9695bd6fb5ea4e4e470f9a782a480f5a919645fac26f4c2f88055"} Jul 06 19:33:11.821387 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:11.821293 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" podStartSLOduration=0.82127373 podStartE2EDuration="821.27373ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:11.818349233 +0000 UTC m=+1681.141084352" watchObservedRunningTime="2026-07-06 19:33:11.82127373 +0000 UTC m=+1681.144008825" Jul 06 19:33:12.547319 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:12.547288 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:12.552121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:12.552071 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:12.801563 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:12.801482 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:12.802509 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:12.802487 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:14.221941 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.221907 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h"] Jul 06 19:33:14.225862 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.225842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.228570 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.228551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-deaeb94f-serving-cert\"" Jul 06 19:33:14.228684 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.228585 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:33:14.236615 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.236595 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h"] Jul 06 19:33:14.327457 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.327424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94be85d2-c421-438d-91f6-c0bfc687f851-openshift-service-ca\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.327624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.327499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.327624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.327566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28d88\" (UniqueName: \"kubernetes.io/projected/94be85d2-c421-438d-91f6-c0bfc687f851-kube-api-access-28d88\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.428782 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.428757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.428935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.428798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28d88\" (UniqueName: \"kubernetes.io/projected/94be85d2-c421-438d-91f6-c0bfc687f851-kube-api-access-28d88\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.428935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.428860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94be85d2-c421-438d-91f6-c0bfc687f851-openshift-service-ca\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.428935 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:14.428908 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-deaeb94f-serving-cert: secret "maas-api-e2e-mt-deaeb94f-serving-cert" not found Jul 06 19:33:14.429108 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:14.428978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls podName:94be85d2-c421-438d-91f6-c0bfc687f851 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:14.928961717 +0000 UTC m=+1684.251696791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls") pod "maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" (UID: "94be85d2-c421-438d-91f6-c0bfc687f851") : secret "maas-api-e2e-mt-deaeb94f-serving-cert" not found Jul 06 19:33:14.429514 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.429497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94be85d2-c421-438d-91f6-c0bfc687f851-openshift-service-ca\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.441336 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.441314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28d88\" (UniqueName: \"kubernetes.io/projected/94be85d2-c421-438d-91f6-c0bfc687f851-kube-api-access-28d88\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.934022 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.933978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:14.936617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:14.936591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls\") pod \"maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:15.138037 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:15.137998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:15.290982 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:33:15.290951 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94be85d2_c421_438d_91f6_c0bfc687f851.slice/crio-8fa129d71d868c9e36da259354f944c228daa6af8b750e596c8024101f438565 WatchSource:0}: Error finding container 8fa129d71d868c9e36da259354f944c228daa6af8b750e596c8024101f438565: Status 404 returned error can't find the container with id 8fa129d71d868c9e36da259354f944c228daa6af8b750e596c8024101f438565 Jul 06 19:33:15.295881 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:15.295855 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h"] Jul 06 19:33:15.817256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:15.817230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" event={"ID":"94be85d2-c421-438d-91f6-c0bfc687f851","Type":"ContainerStarted","Data":"8fa129d71d868c9e36da259354f944c228daa6af8b750e596c8024101f438565"} Jul 06 19:33:16.823402 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:16.823362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" event={"ID":"94be85d2-c421-438d-91f6-c0bfc687f851","Type":"ContainerStarted","Data":"40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16"} Jul 06 19:33:16.823776 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:16.823450 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:16.841349 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:16.841304 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" podStartSLOduration=2.3416857159999998 podStartE2EDuration="2.841290309s" totalImagesPullingTime="499.604593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:16.839601383 +0000 UTC m=+1686.162336489" watchObservedRunningTime="2026-07-06 19:33:16.841290309 +0000 UTC m=+1686.164025402" Jul 06 19:33:22.841449 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:22.841418 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:26.375939 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.375905 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h"] Jul 06 19:33:26.376459 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.376126 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" podUID="94be85d2-c421-438d-91f6-c0bfc687f851" containerName="maas-api" containerID="cri-o://40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16" gracePeriod=30 Jul 06 19:33:26.633320 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.633261 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:26.740246 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.740216 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94be85d2-c421-438d-91f6-c0bfc687f851-openshift-service-ca\") pod \"94be85d2-c421-438d-91f6-c0bfc687f851\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " Jul 06 19:33:26.741583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.740267 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28d88\" (UniqueName: \"kubernetes.io/projected/94be85d2-c421-438d-91f6-c0bfc687f851-kube-api-access-28d88\") pod \"94be85d2-c421-438d-91f6-c0bfc687f851\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " Jul 06 19:33:26.741583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.740299 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls\") pod \"94be85d2-c421-438d-91f6-c0bfc687f851\" (UID: \"94be85d2-c421-438d-91f6-c0bfc687f851\") " Jul 06 19:33:26.741583 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.740608 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94be85d2-c421-438d-91f6-c0bfc687f851-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94be85d2-c421-438d-91f6-c0bfc687f851" (UID: "94be85d2-c421-438d-91f6-c0bfc687f851"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:33:26.742347 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.742324 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94be85d2-c421-438d-91f6-c0bfc687f851" (UID: "94be85d2-c421-438d-91f6-c0bfc687f851"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:33:26.742347 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.742335 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94be85d2-c421-438d-91f6-c0bfc687f851-kube-api-access-28d88" (OuterVolumeSpecName: "kube-api-access-28d88") pod "94be85d2-c421-438d-91f6-c0bfc687f851" (UID: "94be85d2-c421-438d-91f6-c0bfc687f851"). InnerVolumeSpecName "kube-api-access-28d88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:26.841905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.841875 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94be85d2-c421-438d-91f6-c0bfc687f851-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:26.841905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.841901 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28d88\" (UniqueName: \"kubernetes.io/projected/94be85d2-c421-438d-91f6-c0bfc687f851-kube-api-access-28d88\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:26.842068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.841913 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94be85d2-c421-438d-91f6-c0bfc687f851-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:26.879386 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.879360 2577 generic.go:356] "Generic (PLEG): container finished" podID="94be85d2-c421-438d-91f6-c0bfc687f851" containerID="40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16" exitCode=0 Jul 06 19:33:26.879525 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.879414 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" Jul 06 19:33:26.879525 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.879447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" event={"ID":"94be85d2-c421-438d-91f6-c0bfc687f851","Type":"ContainerDied","Data":"40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16"} Jul 06 19:33:26.879525 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.879499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h" event={"ID":"94be85d2-c421-438d-91f6-c0bfc687f851","Type":"ContainerDied","Data":"8fa129d71d868c9e36da259354f944c228daa6af8b750e596c8024101f438565"} Jul 06 19:33:26.879668 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.879531 2577 scope.go:117] "RemoveContainer" containerID="40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16" Jul 06 19:33:26.881275 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.881244 2577 generic.go:356] "Generic (PLEG): container finished" podID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerID="ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0" exitCode=0 Jul 06 19:33:26.881382 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.881321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" event={"ID":"e7c61e70-f87c-4c24-b8f2-5911181bbfa7","Type":"ContainerDied","Data":"ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0"} Jul 06 19:33:26.881790 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.881773 2577 scope.go:117] "RemoveContainer" containerID="ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0" Jul 06 19:33:26.882937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.882903 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:26.883024 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.882996 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:26.883074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.883044 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:26.892297 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.892276 2577 scope.go:117] "RemoveContainer" containerID="40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16" Jul 06 19:33:26.892568 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:26.892550 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16\": container with ID starting with 40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16 not found: ID does not exist" containerID="40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16" Jul 06 19:33:26.892629 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.892575 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16"} err="failed to get container status \"40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16\": rpc error: code = NotFound desc = could not find container \"40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16\": container with ID starting with 40e426023425668d5fe0520909d2bd14610b373344bb8f7198ad35bd884dcd16 not found: ID does not exist" Jul 06 19:33:26.925269 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.925241 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h"] Jul 06 19:33:26.931802 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:26.931777 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-deaeb94f-86464b65c5-lbz9h"] Jul 06 19:33:27.344584 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:27.344544 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94be85d2-c421-438d-91f6-c0bfc687f851" path="/var/lib/kubelet/pods/94be85d2-c421-438d-91f6-c0bfc687f851/volumes" Jul 06 19:33:27.801759 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:27.801723 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:27.890001 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:27.889961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" event={"ID":"e7c61e70-f87c-4c24-b8f2-5911181bbfa7","Type":"ContainerStarted","Data":"9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c"} Jul 06 19:33:28.547440 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:28.547401 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:28.548724 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:28.548699 2577 patch_prober.go:28] interesting pod/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 19:33:28.548804 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:28.548753 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 19:33:29.547190 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:29.547147 2577 patch_prober.go:28] interesting pod/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 19:33:29.547699 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:29.547232 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 19:33:30.548051 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:30.548016 2577 patch_prober.go:28] interesting pod/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 19:33:30.548536 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:30.548074 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 19:33:31.548001 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:31.547965 2577 patch_prober.go:28] interesting pod/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 19:33:31.548332 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:31.548299 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 19:33:32.407347 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:32.407316 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m"] Jul 06 19:33:32.407541 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:32.407518 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" containerID="cri-o://9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c" gracePeriod=30 Jul 06 19:33:37.662068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.662045 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:37.742981 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.742904 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istiod-ca-cert\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.742981 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.742957 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-token\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.742981 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.742981 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-certs\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-data\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743048 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v47cd\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-kube-api-access-v47cd\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743164 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-socket\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743189 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-envoy\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743214 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-podinfo\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743234 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-credential-socket\") pod \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\" (UID: \"e7c61e70-f87c-4c24-b8f2-5911181bbfa7\") " Jul 06 19:33:37.743351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743300 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:33:37.743742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743366 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.743742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743558 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.743742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743628 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.743742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743647 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.743742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743665 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.744016 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.743967 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.745397 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.745367 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-kube-api-access-v47cd" (OuterVolumeSpecName: "kube-api-access-v47cd") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "kube-api-access-v47cd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:37.745502 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.745447 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:37.745777 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.745750 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:33:37.745777 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.745753 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7c61e70-f87c-4c24-b8f2-5911181bbfa7" (UID: "e7c61e70-f87c-4c24-b8f2-5911181bbfa7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.844840 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844809 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.844840 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844834 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.845020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844847 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v47cd\" (UniqueName: \"kubernetes.io/projected/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-kube-api-access-v47cd\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.845020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844861 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.845020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844872 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.845020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844882 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.845020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.844893 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c61e70-f87c-4c24-b8f2-5911181bbfa7-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.958594 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.958562 2577 generic.go:356] "Generic (PLEG): container finished" podID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerID="9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c" exitCode=0 Jul 06 19:33:37.958767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.958621 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" Jul 06 19:33:37.958767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.958633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" event={"ID":"e7c61e70-f87c-4c24-b8f2-5911181bbfa7","Type":"ContainerDied","Data":"9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c"} Jul 06 19:33:37.958767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.958699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m" event={"ID":"e7c61e70-f87c-4c24-b8f2-5911181bbfa7","Type":"ContainerDied","Data":"c23fb7806ae9695bd6fb5ea4e4e470f9a782a480f5a919645fac26f4c2f88055"} Jul 06 19:33:37.958767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.958720 2577 scope.go:117] "RemoveContainer" containerID="9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c" Jul 06 19:33:37.968380 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.968360 2577 scope.go:117] "RemoveContainer" containerID="ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0" Jul 06 19:33:37.977205 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.977185 2577 scope.go:117] "RemoveContainer" containerID="9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c" Jul 06 19:33:37.977802 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:37.977650 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c\": container with ID starting with 9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c not found: ID does not exist" containerID="9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c" Jul 06 19:33:37.977802 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.977692 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c"} err="failed to get container status \"9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c\": rpc error: code = NotFound desc = could not find container \"9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c\": container with ID starting with 9da68188723da53697056c076b40851c2d732a9a9422d002d863f2ced804df2c not found: ID does not exist" Jul 06 19:33:37.977802 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.977719 2577 scope.go:117] "RemoveContainer" containerID="ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0" Jul 06 19:33:37.978287 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:37.978266 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0\": container with ID starting with ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0 not found: ID does not exist" containerID="ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0" Jul 06 19:33:37.978383 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.978297 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0"} err="failed to get container status \"ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0\": rpc error: code = NotFound desc = could not find container \"ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0\": container with ID starting with ca9f66c946ec4d6ec32d7103f83d661031f381f133976932119d5b0a3e658ee0 not found: ID does not exist" Jul 06 19:33:37.980444 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.980422 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m"] Jul 06 19:33:37.983961 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:37.983937 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-deaeb94f-openshift-default-76c5c6f587-gvk6m"] Jul 06 19:33:39.343558 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:39.343519 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" path="/var/lib/kubelet/pods/e7c61e70-f87c-4c24-b8f2-5911181bbfa7/volumes" Jul 06 19:33:51.979773 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.979742 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk"] Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980132 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94be85d2-c421-438d-91f6-c0bfc687f851" containerName="maas-api" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980145 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94be85d2-c421-438d-91f6-c0bfc687f851" containerName="maas-api" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980172 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980178 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980186 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980191 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980254 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" Jul 06 19:33:51.980400 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.980262 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94be85d2-c421-438d-91f6-c0bfc687f851" containerName="maas-api" Jul 06 19:33:51.982468 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.982450 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:51.985711 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:51.985693 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-08ef9dd4-openshift-default-dockercfg-sfnd2\"" Jul 06 19:33:52.006425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.006400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk"] Jul 06 19:33:52.076928 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.076894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-socket\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.076928 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.076933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7828341-ebba-4080-878d-7413ccee6d90-istio-podinfo\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.076956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7828341-ebba-4080-878d-7413ccee6d90-istiod-ca-cert\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.077045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-certs\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.077065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6tjs\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-kube-api-access-r6tjs\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077185 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.077170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-envoy\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077399 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.077243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-istio-token\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077399 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.077279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-credential-socket\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.077399 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.077302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-data\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.177845 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.177814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-istio-token\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.177992 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.177865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-credential-socket\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.177992 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.177894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-data\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.177992 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.177927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-socket\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.177992 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.177953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7828341-ebba-4080-878d-7413ccee6d90-istio-podinfo\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.177992 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.177976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7828341-ebba-4080-878d-7413ccee6d90-istiod-ca-cert\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178305 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-certs\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178305 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6tjs\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-kube-api-access-r6tjs\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178305 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-envoy\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178459 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-data\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178459 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-credential-socket\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178563 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-socket\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.178647 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-certs\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.179019 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.178999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7828341-ebba-4080-878d-7413ccee6d90-istiod-ca-cert\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.180318 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.180296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-envoy\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.180576 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.180557 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7828341-ebba-4080-878d-7413ccee6d90-istio-podinfo\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.185892 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.185871 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-istio-token\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.186061 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.186044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6tjs\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-kube-api-access-r6tjs\") pod \"e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.293471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.293381 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:52.436457 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.436423 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk"] Jul 06 19:33:52.438128 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:33:52.438070 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7828341_ebba_4080_878d_7413ccee6d90.slice/crio-253cf6310b4ff07232fd80ff2a83059f47004f1e43aa5e07bf0959a8cce768f3 WatchSource:0}: Error finding container 253cf6310b4ff07232fd80ff2a83059f47004f1e43aa5e07bf0959a8cce768f3: Status 404 returned error can't find the container with id 253cf6310b4ff07232fd80ff2a83059f47004f1e43aa5e07bf0959a8cce768f3 Jul 06 19:33:52.440422 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.440390 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:52.440511 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.440463 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:52.440511 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:52.440491 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:33:53.040491 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:53.040453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" event={"ID":"d7828341-ebba-4080-878d-7413ccee6d90","Type":"ContainerStarted","Data":"4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea"} Jul 06 19:33:53.040907 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:53.040506 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" event={"ID":"d7828341-ebba-4080-878d-7413ccee6d90","Type":"ContainerStarted","Data":"253cf6310b4ff07232fd80ff2a83059f47004f1e43aa5e07bf0959a8cce768f3"} Jul 06 19:33:53.293973 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:53.293868 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:53.299121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:53.299078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:53.321834 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:53.321786 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podStartSLOduration=2.321770987 podStartE2EDuration="2.321770987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:53.069807857 +0000 UTC m=+1722.392542951" watchObservedRunningTime="2026-07-06 19:33:53.321770987 +0000 UTC m=+1722.644506143" Jul 06 19:33:54.045234 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:54.045196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:54.046049 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:54.046029 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:33:55.093804 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.093772 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf"] Jul 06 19:33:55.094236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.094223 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7c61e70-f87c-4c24-b8f2-5911181bbfa7" containerName="istio-proxy" Jul 06 19:33:55.096330 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.096311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.099814 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.099792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:33:55.100055 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.100041 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-08ef9dd4-serving-cert\"" Jul 06 19:33:55.115901 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.115874 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf"] Jul 06 19:33:55.207924 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.207893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.208126 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.207945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61705567-5f25-4fcf-94bb-c0a4601783f7-openshift-service-ca\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.208126 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.208038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqm5\" (UniqueName: \"kubernetes.io/projected/61705567-5f25-4fcf-94bb-c0a4601783f7-kube-api-access-mcqm5\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.308932 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.308895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61705567-5f25-4fcf-94bb-c0a4601783f7-openshift-service-ca\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.308932 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.308933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqm5\" (UniqueName: \"kubernetes.io/projected/61705567-5f25-4fcf-94bb-c0a4601783f7-kube-api-access-mcqm5\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.309233 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.309000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.309233 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:55.309134 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-08ef9dd4-serving-cert: secret "maas-api-e2e-mt-08ef9dd4-serving-cert" not found Jul 06 19:33:55.309233 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:33:55.309210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls podName:61705567-5f25-4fcf-94bb-c0a4601783f7 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:55.809189744 +0000 UTC m=+1725.131924824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls") pod "maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" (UID: "61705567-5f25-4fcf-94bb-c0a4601783f7") : secret "maas-api-e2e-mt-08ef9dd4-serving-cert" not found Jul 06 19:33:55.309675 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.309648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61705567-5f25-4fcf-94bb-c0a4601783f7-openshift-service-ca\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.318767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.318743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqm5\" (UniqueName: \"kubernetes.io/projected/61705567-5f25-4fcf-94bb-c0a4601783f7-kube-api-access-mcqm5\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.813244 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.813211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:55.815602 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:55.815584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls\") pod \"maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:56.006673 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:56.006644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:56.143533 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:56.143506 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf"] Jul 06 19:33:56.145028 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:33:56.145005 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61705567_5f25_4fcf_94bb_c0a4601783f7.slice/crio-d8011be4a803551da4bcf61ff8ab92b19970a37fbb4684e890a531f5928a197d WatchSource:0}: Error finding container d8011be4a803551da4bcf61ff8ab92b19970a37fbb4684e890a531f5928a197d: Status 404 returned error can't find the container with id d8011be4a803551da4bcf61ff8ab92b19970a37fbb4684e890a531f5928a197d Jul 06 19:33:57.063223 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:57.063189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" event={"ID":"61705567-5f25-4fcf-94bb-c0a4601783f7","Type":"ContainerStarted","Data":"91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002"} Jul 06 19:33:57.063425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:57.063246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" event={"ID":"61705567-5f25-4fcf-94bb-c0a4601783f7","Type":"ContainerStarted","Data":"d8011be4a803551da4bcf61ff8ab92b19970a37fbb4684e890a531f5928a197d"} Jul 06 19:33:57.063425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:57.063287 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:33:57.082234 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:33:57.082185 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" podStartSLOduration=1.656269416 podStartE2EDuration="2.082168771s" totalImagesPullingTime="425.899355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:57.080479435 +0000 UTC m=+1726.403214530" watchObservedRunningTime="2026-07-06 19:33:57.082168771 +0000 UTC m=+1726.404903865" Jul 06 19:34:03.074232 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:03.074199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:34:09.047273 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.047197 2577 patch_prober.go:28] interesting pod/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 19:34:09.047273 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.047260 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 19:34:09.129707 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.129664 2577 generic.go:356] "Generic (PLEG): container finished" podID="d7828341-ebba-4080-878d-7413ccee6d90" containerID="4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea" exitCode=0 Jul 06 19:34:09.129892 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.129726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" event={"ID":"d7828341-ebba-4080-878d-7413ccee6d90","Type":"ContainerDied","Data":"4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea"} Jul 06 19:34:09.130205 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.130187 2577 scope.go:117] "RemoveContainer" containerID="4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea" Jul 06 19:34:09.131244 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.131216 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:34:09.131355 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.131298 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:34:09.131355 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:09.131348 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:34:10.141113 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:10.140549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" event={"ID":"d7828341-ebba-4080-878d-7413ccee6d90","Type":"ContainerStarted","Data":"66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e"} Jul 06 19:34:10.294070 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:10.294032 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:34:10.294374 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:10.294352 2577 patch_prober.go:28] interesting pod/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 19:34:10.294421 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:10.294400 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 19:34:11.294527 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:11.294494 2577 patch_prober.go:28] interesting pod/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 19:34:11.294904 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:11.294556 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 19:34:12.294773 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:12.294730 2577 patch_prober.go:28] interesting pod/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 19:34:12.295284 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:12.294794 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 19:34:13.294225 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:13.294189 2577 patch_prober.go:28] interesting pod/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 19:34:13.294407 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:13.294243 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 19:34:14.297680 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:14.297641 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:34:14.298050 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:14.298019 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:34:14.298735 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:14.298721 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:34:37.324765 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.324734 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf"] Jul 06 19:34:37.325397 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.324984 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" podUID="61705567-5f25-4fcf-94bb-c0a4601783f7" containerName="maas-api" containerID="cri-o://91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002" gracePeriod=30 Jul 06 19:34:37.574260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.574237 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:34:37.600243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.600169 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61705567-5f25-4fcf-94bb-c0a4601783f7-openshift-service-ca\") pod \"61705567-5f25-4fcf-94bb-c0a4601783f7\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " Jul 06 19:34:37.600243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.600233 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls\") pod \"61705567-5f25-4fcf-94bb-c0a4601783f7\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " Jul 06 19:34:37.600425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.600274 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcqm5\" (UniqueName: \"kubernetes.io/projected/61705567-5f25-4fcf-94bb-c0a4601783f7-kube-api-access-mcqm5\") pod \"61705567-5f25-4fcf-94bb-c0a4601783f7\" (UID: \"61705567-5f25-4fcf-94bb-c0a4601783f7\") " Jul 06 19:34:37.600613 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.600582 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61705567-5f25-4fcf-94bb-c0a4601783f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61705567-5f25-4fcf-94bb-c0a4601783f7" (UID: "61705567-5f25-4fcf-94bb-c0a4601783f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:37.602449 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.602426 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61705567-5f25-4fcf-94bb-c0a4601783f7" (UID: "61705567-5f25-4fcf-94bb-c0a4601783f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:34:37.602565 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.602425 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61705567-5f25-4fcf-94bb-c0a4601783f7-kube-api-access-mcqm5" (OuterVolumeSpecName: "kube-api-access-mcqm5") pod "61705567-5f25-4fcf-94bb-c0a4601783f7" (UID: "61705567-5f25-4fcf-94bb-c0a4601783f7"). InnerVolumeSpecName "kube-api-access-mcqm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:37.701127 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.701097 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61705567-5f25-4fcf-94bb-c0a4601783f7-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:34:37.701127 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.701122 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61705567-5f25-4fcf-94bb-c0a4601783f7-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:34:37.701127 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:37.701131 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcqm5\" (UniqueName: \"kubernetes.io/projected/61705567-5f25-4fcf-94bb-c0a4601783f7-kube-api-access-mcqm5\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:34:38.286187 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.286150 2577 generic.go:356] "Generic (PLEG): container finished" podID="61705567-5f25-4fcf-94bb-c0a4601783f7" containerID="91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002" exitCode=0 Jul 06 19:34:38.286387 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.286202 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" Jul 06 19:34:38.286387 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.286231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" event={"ID":"61705567-5f25-4fcf-94bb-c0a4601783f7","Type":"ContainerDied","Data":"91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002"} Jul 06 19:34:38.286387 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.286282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf" event={"ID":"61705567-5f25-4fcf-94bb-c0a4601783f7","Type":"ContainerDied","Data":"d8011be4a803551da4bcf61ff8ab92b19970a37fbb4684e890a531f5928a197d"} Jul 06 19:34:38.286387 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.286305 2577 scope.go:117] "RemoveContainer" containerID="91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002" Jul 06 19:34:38.295704 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.295689 2577 scope.go:117] "RemoveContainer" containerID="91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002" Jul 06 19:34:38.295951 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:34:38.295935 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002\": container with ID starting with 91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002 not found: ID does not exist" containerID="91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002" Jul 06 19:34:38.295999 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.295959 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002"} err="failed to get container status \"91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002\": rpc error: code = NotFound desc = could not find container \"91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002\": container with ID starting with 91389702c25621177c82f92c0ca20730b7208719258a3caa2959644908aa7002 not found: ID does not exist" Jul 06 19:34:38.308415 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.308391 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf"] Jul 06 19:34:38.311248 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:38.311228 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-08ef9dd4-795c44494c-ztdjf"] Jul 06 19:34:39.343241 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:34:39.343211 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61705567-5f25-4fcf-94bb-c0a4601783f7" path="/var/lib/kubelet/pods/61705567-5f25-4fcf-94bb-c0a4601783f7/volumes" Jul 06 19:35:11.312868 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:11.312840 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:35:11.316303 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:11.316280 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:35:11.316465 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:11.316449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:35:11.319646 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:11.319628 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:35:36.871589 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:36.871554 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk"] Jul 06 19:35:36.872123 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:36.871789 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" containerID="cri-o://66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e" gracePeriod=30 Jul 06 19:35:42.136905 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.136857 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:35:42.264520 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264489 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7828341-ebba-4080-878d-7413ccee6d90-istio-podinfo\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.264520 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264523 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6tjs\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-kube-api-access-r6tjs\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.264857 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-credential-socket\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.264857 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264582 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7828341-ebba-4080-878d-7413ccee6d90-istiod-ca-cert\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.264857 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264638 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-socket\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.264857 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264664 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-certs\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264959 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-istio-token\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264959 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264982 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.264994 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265031 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-envoy\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265052 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7828341-ebba-4080-878d-7413ccee6d90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:42.265121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265117 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-data\") pod \"d7828341-ebba-4080-878d-7413ccee6d90\" (UID: \"d7828341-ebba-4080-878d-7413ccee6d90\") " Jul 06 19:35:42.265463 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265403 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.265463 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265423 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7828341-ebba-4080-878d-7413ccee6d90-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.265577 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265561 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.265635 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.265580 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.266265 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.266238 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-data" (OuterVolumeSpecName: "istio-data") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:35:42.266881 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.266861 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7828341-ebba-4080-878d-7413ccee6d90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:35:42.266977 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.266960 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:42.267018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.266989 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-kube-api-access-r6tjs" (OuterVolumeSpecName: "kube-api-access-r6tjs") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "kube-api-access-r6tjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:42.267054 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.267038 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d7828341-ebba-4080-878d-7413ccee6d90" (UID: "d7828341-ebba-4080-878d-7413ccee6d90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:35:42.366036 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.366015 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.366036 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.366034 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7828341-ebba-4080-878d-7413ccee6d90-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.366184 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.366042 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6tjs\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-kube-api-access-r6tjs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.366184 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.366051 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7828341-ebba-4080-878d-7413ccee6d90-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.366184 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.366061 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7828341-ebba-4080-878d-7413ccee6d90-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.616919 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.616882 2577 generic.go:356] "Generic (PLEG): container finished" podID="d7828341-ebba-4080-878d-7413ccee6d90" containerID="66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e" exitCode=0 Jul 06 19:35:42.617077 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.616928 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" Jul 06 19:35:42.617077 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.616938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" event={"ID":"d7828341-ebba-4080-878d-7413ccee6d90","Type":"ContainerDied","Data":"66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e"} Jul 06 19:35:42.617077 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.616981 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk" event={"ID":"d7828341-ebba-4080-878d-7413ccee6d90","Type":"ContainerDied","Data":"253cf6310b4ff07232fd80ff2a83059f47004f1e43aa5e07bf0959a8cce768f3"} Jul 06 19:35:42.617077 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.617001 2577 scope.go:117] "RemoveContainer" containerID="66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e" Jul 06 19:35:42.626556 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.626325 2577 scope.go:117] "RemoveContainer" containerID="4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea" Jul 06 19:35:42.635131 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.635115 2577 scope.go:117] "RemoveContainer" containerID="66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e" Jul 06 19:35:42.635372 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:35:42.635349 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e\": container with ID starting with 66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e not found: ID does not exist" containerID="66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e" Jul 06 19:35:42.635470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.635377 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e"} err="failed to get container status \"66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e\": rpc error: code = NotFound desc = could not find container \"66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e\": container with ID starting with 66fc7366dc6d1d62d97c18b7e3af0ec45e2cf6fa478f091c4e0523b3dd99083e not found: ID does not exist" Jul 06 19:35:42.635470 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.635401 2577 scope.go:117] "RemoveContainer" containerID="4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea" Jul 06 19:35:42.635652 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:35:42.635636 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea\": container with ID starting with 4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea not found: ID does not exist" containerID="4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea" Jul 06 19:35:42.635706 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.635661 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea"} err="failed to get container status \"4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea\": rpc error: code = NotFound desc = could not find container \"4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea\": container with ID starting with 4c8b989e6271993ab3bd245029ebb6cd1522e6e10ff878fda16c2b0a2ee225ea not found: ID does not exist" Jul 06 19:35:42.642209 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.642184 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk"] Jul 06 19:35:42.645864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:42.645841 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-08ef9dd4-openshift-default-5bb7f6f659-vs6vk"] Jul 06 19:35:43.343597 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:35:43.343566 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7828341-ebba-4080-878d-7413ccee6d90" path="/var/lib/kubelet/pods/d7828341-ebba-4080-878d-7413ccee6d90/volumes" Jul 06 19:36:31.888527 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888493 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj"] Jul 06 19:36:31.889005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888893 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61705567-5f25-4fcf-94bb-c0a4601783f7" containerName="maas-api" Jul 06 19:36:31.889005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888905 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="61705567-5f25-4fcf-94bb-c0a4601783f7" containerName="maas-api" Jul 06 19:36:31.889005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888922 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" Jul 06 19:36:31.889005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888927 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" Jul 06 19:36:31.889005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888953 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" Jul 06 19:36:31.889005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.888959 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" Jul 06 19:36:31.889229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.889011 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" Jul 06 19:36:31.889229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.889022 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="61705567-5f25-4fcf-94bb-c0a4601783f7" containerName="maas-api" Jul 06 19:36:31.889229 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.889031 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7828341-ebba-4080-878d-7413ccee6d90" containerName="istio-proxy" Jul 06 19:36:31.892298 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.892279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.895545 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.895527 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c6176e-openshift-default-dockercfg-p9rqx\"" Jul 06 19:36:31.906126 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.906106 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj"] Jul 06 19:36:31.984533 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl8v9\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-kube-api-access-vl8v9\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984683 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-certs\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984753 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3358c1-ead7-4a30-a04b-d96b08728913-istiod-ca-cert\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984800 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-socket\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984849 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-credential-socket\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984894 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-data\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984894 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-envoy\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984995 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-podinfo\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:31.984995 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:31.984957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-token\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.085707 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.085669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-data\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.085882 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.085715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-envoy\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.085882 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.085751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-podinfo\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.085882 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.085787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-token\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086242 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.085838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl8v9\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-kube-api-access-vl8v9\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086341 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-certs\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086341 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3358c1-ead7-4a30-a04b-d96b08728913-istiod-ca-cert\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086341 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-data\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086504 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-socket\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086504 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-credential-socket\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-credential-socket\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.086965 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.086939 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3358c1-ead7-4a30-a04b-d96b08728913-istiod-ca-cert\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.087109 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.087035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-certs\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.087109 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.087041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-socket\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.088259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.088237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-envoy\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.088792 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.088769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-podinfo\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.093845 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.093818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl8v9\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-kube-api-access-vl8v9\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.093926 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.093871 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-token\") pod \"e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.202464 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.202424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:32.354891 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.354858 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj"] Jul 06 19:36:32.356560 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:36:32.356532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3358c1_ead7_4a30_a04b_d96b08728913.slice/crio-b3a4b24841e76f61f74d6a11cb2e0543b6ee8dfbbe8647ca12b6a7eb360a824a WatchSource:0}: Error finding container b3a4b24841e76f61f74d6a11cb2e0543b6ee8dfbbe8647ca12b6a7eb360a824a: Status 404 returned error can't find the container with id b3a4b24841e76f61f74d6a11cb2e0543b6ee8dfbbe8647ca12b6a7eb360a824a Jul 06 19:36:32.358737 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.358700 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:32.358846 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.358781 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:32.358846 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.358837 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:32.881679 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.881608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" event={"ID":"3e3358c1-ead7-4a30-a04b-d96b08728913","Type":"ContainerStarted","Data":"2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e"} Jul 06 19:36:32.881679 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.881655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" event={"ID":"3e3358c1-ead7-4a30-a04b-d96b08728913","Type":"ContainerStarted","Data":"b3a4b24841e76f61f74d6a11cb2e0543b6ee8dfbbe8647ca12b6a7eb360a824a"} Jul 06 19:36:32.904914 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:32.904866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podStartSLOduration=1.904852134 podStartE2EDuration="1.904852134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:32.902433623 +0000 UTC m=+1882.225168718" watchObservedRunningTime="2026-07-06 19:36:32.904852134 +0000 UTC m=+1882.227587227" Jul 06 19:36:33.203469 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:33.203434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:33.208806 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:33.208782 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:33.887301 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:33.887274 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:33.888149 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:33.888127 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:34.975320 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:34.975290 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457"] Jul 06 19:36:34.979045 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:34.979024 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:34.981815 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:34.981795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-c6176e-serving-cert\"" Jul 06 19:36:34.981935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:34.981881 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:36:34.991201 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:34.991074 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457"] Jul 06 19:36:35.113950 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.113921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffeb787a-2567-42a6-8192-d91e829231bc-maas-api-tls\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.113950 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.113950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeb787a-2567-42a6-8192-d91e829231bc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.114163 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.114020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgwz\" (UniqueName: \"kubernetes.io/projected/ffeb787a-2567-42a6-8192-d91e829231bc-kube-api-access-hmgwz\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.214554 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.214530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeb787a-2567-42a6-8192-d91e829231bc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.214686 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.214576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgwz\" (UniqueName: \"kubernetes.io/projected/ffeb787a-2567-42a6-8192-d91e829231bc-kube-api-access-hmgwz\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.214686 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.214643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffeb787a-2567-42a6-8192-d91e829231bc-maas-api-tls\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.215142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.215120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeb787a-2567-42a6-8192-d91e829231bc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.216996 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.216974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffeb787a-2567-42a6-8192-d91e829231bc-maas-api-tls\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.222863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.222841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgwz\" (UniqueName: \"kubernetes.io/projected/ffeb787a-2567-42a6-8192-d91e829231bc-kube-api-access-hmgwz\") pod \"maas-api-e2e-inf-a-c6176e-848fdc8467-29457\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.292359 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.292303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:35.428914 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.428855 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457"] Jul 06 19:36:35.431130 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:36:35.431102 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffeb787a_2567_42a6_8192_d91e829231bc.slice/crio-9ec25253129a32f5923b1cf900cb94a0e5904a4faf483dfa80c1a727d7ea1b33 WatchSource:0}: Error finding container 9ec25253129a32f5923b1cf900cb94a0e5904a4faf483dfa80c1a727d7ea1b33: Status 404 returned error can't find the container with id 9ec25253129a32f5923b1cf900cb94a0e5904a4faf483dfa80c1a727d7ea1b33 Jul 06 19:36:35.432549 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.432530 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:36:35.899742 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:35.899717 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" event={"ID":"ffeb787a-2567-42a6-8192-d91e829231bc","Type":"ContainerStarted","Data":"9ec25253129a32f5923b1cf900cb94a0e5904a4faf483dfa80c1a727d7ea1b33"} Jul 06 19:36:36.906441 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:36.906406 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" event={"ID":"ffeb787a-2567-42a6-8192-d91e829231bc","Type":"ContainerStarted","Data":"7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7"} Jul 06 19:36:36.906841 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:36.906476 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:36.924974 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:36.924907 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" podStartSLOduration=2.476089096 podStartE2EDuration="2.924887141s" totalImagesPullingTime="448.798045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:36.924158127 +0000 UTC m=+1886.246893222" watchObservedRunningTime="2026-07-06 19:36:36.924887141 +0000 UTC m=+1886.247622238" Jul 06 19:36:40.087823 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.087794 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt"] Jul 06 19:36:40.091636 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.091616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.094492 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.094471 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-93827d-openshift-default-dockercfg-dwhwl\"" Jul 06 19:36:40.099878 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.099839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt"] Jul 06 19:36:40.158660 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgkzc\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-kube-api-access-rgkzc\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.158777 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-envoy\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.158824 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-podinfo\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.158824 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-socket\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.158891 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-token\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.158937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-credential-socket\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.158937 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-certs\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.159001 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istiod-ca-cert\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.159001 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.158968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-data\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259549 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-envoy\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-podinfo\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-socket\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-token\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-credential-socket\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259934 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-certs\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259934 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istiod-ca-cert\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.259934 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-data\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.260117 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.259936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgkzc\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-kube-api-access-rgkzc\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.260117 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.260037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-socket\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.260386 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.260331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-certs\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.260515 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.260420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-data\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.260515 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.260473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-credential-socket\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.260638 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.260575 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istiod-ca-cert\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.261875 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.261855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-envoy\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.262344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.262324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-podinfo\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.267593 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.267567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-token\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.267856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.267834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgkzc\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-kube-api-access-rgkzc\") pod \"e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.404962 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.404936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:40.547282 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.547252 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt"] Jul 06 19:36:40.548220 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:36:40.548195 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1b5edb_65da_498f_b1c5_2ee6dc808517.slice/crio-c3040ff3e9ede11bd10222459928bb48fb891fe6938c2463fc8fae032f758f4b WatchSource:0}: Error finding container c3040ff3e9ede11bd10222459928bb48fb891fe6938c2463fc8fae032f758f4b: Status 404 returned error can't find the container with id c3040ff3e9ede11bd10222459928bb48fb891fe6938c2463fc8fae032f758f4b Jul 06 19:36:40.550712 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.550678 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:40.550821 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.550757 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:40.550821 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.550804 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:40.929778 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.929740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" event={"ID":"7f1b5edb-65da-498f-b1c5-2ee6dc808517","Type":"ContainerStarted","Data":"ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b"} Jul 06 19:36:40.929961 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.929830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" event={"ID":"7f1b5edb-65da-498f-b1c5-2ee6dc808517","Type":"ContainerStarted","Data":"c3040ff3e9ede11bd10222459928bb48fb891fe6938c2463fc8fae032f758f4b"} Jul 06 19:36:40.951940 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:40.951891 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podStartSLOduration=0.951875416 podStartE2EDuration="951.875416ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:40.950157985 +0000 UTC m=+1890.272893082" watchObservedRunningTime="2026-07-06 19:36:40.951875416 +0000 UTC m=+1890.274610509" Jul 06 19:36:41.405893 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:41.405867 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:41.411050 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:41.411027 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:41.935375 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:41.935344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:41.936408 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:41.936392 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:36:42.917186 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:42.917159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:36:49.529752 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.529712 2577 patch_prober.go:28] interesting pod/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:50652->10.132.0.46:15021: read: connection reset by peer" start-of-body= Jul 06 19:36:49.530195 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.529784 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:50652->10.132.0.46:15021: read: connection reset by peer" Jul 06 19:36:49.994331 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.994298 2577 generic.go:356] "Generic (PLEG): container finished" podID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerID="2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e" exitCode=0 Jul 06 19:36:49.994495 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.994376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" event={"ID":"3e3358c1-ead7-4a30-a04b-d96b08728913","Type":"ContainerDied","Data":"2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e"} Jul 06 19:36:49.994802 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.994786 2577 scope.go:117] "RemoveContainer" containerID="2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e" Jul 06 19:36:49.995851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.995822 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:49.995929 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.995907 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:49.995984 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:49.995965 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:51.001379 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:51.001346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" event={"ID":"3e3358c1-ead7-4a30-a04b-d96b08728913","Type":"ContainerStarted","Data":"1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e"} Jul 06 19:36:51.203235 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:51.203202 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:51.203441 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:51.203420 2577 patch_prober.go:28] interesting pod/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 06 19:36:51.203489 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:51.203467 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 06 19:36:52.202959 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:52.202919 2577 patch_prober.go:28] interesting pod/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 06 19:36:52.203368 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:52.202979 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 06 19:36:53.202985 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:53.202942 2577 patch_prober.go:28] interesting pod/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 06 19:36:53.203542 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:53.203000 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 06 19:36:54.203097 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:54.203044 2577 patch_prober.go:28] interesting pod/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 06 19:36:54.203502 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:54.203116 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 06 19:36:55.206383 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:55.206352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:55.206771 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:55.206610 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:55.207357 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:55.207337 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:36:57.977249 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:57.977207 2577 patch_prober.go:28] interesting pod/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 19:36:57.977690 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:57.977307 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 19:36:59.050570 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:59.050538 2577 generic.go:356] "Generic (PLEG): container finished" podID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerID="ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b" exitCode=0 Jul 06 19:36:59.050993 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:59.050615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" event={"ID":"7f1b5edb-65da-498f-b1c5-2ee6dc808517","Type":"ContainerDied","Data":"ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b"} Jul 06 19:36:59.051049 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:59.051018 2577 scope.go:117] "RemoveContainer" containerID="ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b" Jul 06 19:36:59.051990 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:59.051964 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:59.052065 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:59.052029 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:36:59.052065 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:36:59.052060 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:37:00.060776 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:00.060737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" event={"ID":"7f1b5edb-65da-498f-b1c5-2ee6dc808517","Type":"ContainerStarted","Data":"1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc"} Jul 06 19:37:00.405784 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:00.405755 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:37:00.405965 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:00.405945 2577 patch_prober.go:28] interesting pod/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 19:37:00.406016 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:00.405988 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 19:37:01.405955 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:01.405920 2577 patch_prober.go:28] interesting pod/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 19:37:01.406366 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:01.405969 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 19:37:02.405864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:02.405826 2577 patch_prober.go:28] interesting pod/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 19:37:02.406044 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:02.405883 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 19:37:03.405441 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:03.405399 2577 patch_prober.go:28] interesting pod/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 19:37:03.405622 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:03.405488 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 19:37:04.408538 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:04.408510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:37:04.408914 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:04.408896 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:37:04.409716 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:04.409699 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:37:45.022190 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.022154 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk"] Jul 06 19:37:45.024739 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.024721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.027562 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.027536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-reuse-82e679-serving-cert\"" Jul 06 19:37:45.046488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.046468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk"] Jul 06 19:37:45.146365 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.146335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.146517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.146371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2kv\" (UniqueName: \"kubernetes.io/projected/280d688c-2e79-49fc-ba50-aac982990938-kube-api-access-pb2kv\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.146517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.146504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/280d688c-2e79-49fc-ba50-aac982990938-openshift-service-ca\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.247523 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.247488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/280d688c-2e79-49fc-ba50-aac982990938-openshift-service-ca\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.247701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.247569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.247701 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.247595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2kv\" (UniqueName: \"kubernetes.io/projected/280d688c-2e79-49fc-ba50-aac982990938-kube-api-access-pb2kv\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.247791 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:37:45.247729 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-reuse-82e679-serving-cert: secret "maas-api-e2e-reuse-82e679-serving-cert" not found Jul 06 19:37:45.247842 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:37:45.247828 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls podName:280d688c-2e79-49fc-ba50-aac982990938 nodeName:}" failed. No retries permitted until 2026-07-06 19:37:45.747803334 +0000 UTC m=+1955.070538406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls") pod "maas-api-e2e-reuse-82e679-5b7489657-5ngfk" (UID: "280d688c-2e79-49fc-ba50-aac982990938") : secret "maas-api-e2e-reuse-82e679-serving-cert" not found Jul 06 19:37:45.248322 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.248305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/280d688c-2e79-49fc-ba50-aac982990938-openshift-service-ca\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.259649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.259626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2kv\" (UniqueName: \"kubernetes.io/projected/280d688c-2e79-49fc-ba50-aac982990938-kube-api-access-pb2kv\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.753702 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.753668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.756053 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.756027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls\") pod \"maas-api-e2e-reuse-82e679-5b7489657-5ngfk\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:45.935149 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:45.935121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:46.069789 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:46.069763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk"] Jul 06 19:37:46.071770 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:37:46.071744 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280d688c_2e79_49fc_ba50_aac982990938.slice/crio-92036c3866906178da06088d2ced5c0e327645137392545fac33e5da79ac786c WatchSource:0}: Error finding container 92036c3866906178da06088d2ced5c0e327645137392545fac33e5da79ac786c: Status 404 returned error can't find the container with id 92036c3866906178da06088d2ced5c0e327645137392545fac33e5da79ac786c Jul 06 19:37:46.310055 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:46.309974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" event={"ID":"280d688c-2e79-49fc-ba50-aac982990938","Type":"ContainerStarted","Data":"92036c3866906178da06088d2ced5c0e327645137392545fac33e5da79ac786c"} Jul 06 19:37:47.317490 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:47.317454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" event={"ID":"280d688c-2e79-49fc-ba50-aac982990938","Type":"ContainerStarted","Data":"76e6410ac6400d1682a0136503f1d28080ced1195bec7b5cec284674dfcbea95"} Jul 06 19:37:47.317885 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:47.317562 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:37:47.343375 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:47.341980 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" podStartSLOduration=1.9853485339999999 podStartE2EDuration="2.341961496s" totalImagesPullingTime="356.612962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:47.337949447 +0000 UTC m=+1956.660684541" watchObservedRunningTime="2026-07-06 19:37:47.341961496 +0000 UTC m=+1956.664696592" Jul 06 19:37:53.330132 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:37:53.330078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:38:22.294979 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.294941 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk"] Jul 06 19:38:22.295555 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.295209 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" podUID="280d688c-2e79-49fc-ba50-aac982990938" containerName="maas-api" containerID="cri-o://76e6410ac6400d1682a0136503f1d28080ced1195bec7b5cec284674dfcbea95" gracePeriod=30 Jul 06 19:38:22.505224 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.505193 2577 generic.go:356] "Generic (PLEG): container finished" podID="280d688c-2e79-49fc-ba50-aac982990938" containerID="76e6410ac6400d1682a0136503f1d28080ced1195bec7b5cec284674dfcbea95" exitCode=0 Jul 06 19:38:22.505390 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.505232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" event={"ID":"280d688c-2e79-49fc-ba50-aac982990938","Type":"ContainerDied","Data":"76e6410ac6400d1682a0136503f1d28080ced1195bec7b5cec284674dfcbea95"} Jul 06 19:38:22.557541 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.557490 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:38:22.675725 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.675700 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls\") pod \"280d688c-2e79-49fc-ba50-aac982990938\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " Jul 06 19:38:22.675844 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.675782 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/280d688c-2e79-49fc-ba50-aac982990938-openshift-service-ca\") pod \"280d688c-2e79-49fc-ba50-aac982990938\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " Jul 06 19:38:22.675844 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.675811 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb2kv\" (UniqueName: \"kubernetes.io/projected/280d688c-2e79-49fc-ba50-aac982990938-kube-api-access-pb2kv\") pod \"280d688c-2e79-49fc-ba50-aac982990938\" (UID: \"280d688c-2e79-49fc-ba50-aac982990938\") " Jul 06 19:38:22.676171 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.676147 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280d688c-2e79-49fc-ba50-aac982990938-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "280d688c-2e79-49fc-ba50-aac982990938" (UID: "280d688c-2e79-49fc-ba50-aac982990938"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:38:22.677814 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.677793 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280d688c-2e79-49fc-ba50-aac982990938-kube-api-access-pb2kv" (OuterVolumeSpecName: "kube-api-access-pb2kv") pod "280d688c-2e79-49fc-ba50-aac982990938" (UID: "280d688c-2e79-49fc-ba50-aac982990938"). InnerVolumeSpecName "kube-api-access-pb2kv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:22.677888 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.677841 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "280d688c-2e79-49fc-ba50-aac982990938" (UID: "280d688c-2e79-49fc-ba50-aac982990938"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:38:22.777064 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.777038 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/280d688c-2e79-49fc-ba50-aac982990938-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:38:22.777064 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.777061 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb2kv\" (UniqueName: \"kubernetes.io/projected/280d688c-2e79-49fc-ba50-aac982990938-kube-api-access-pb2kv\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:38:22.777236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:22.777073 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/280d688c-2e79-49fc-ba50-aac982990938-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:38:23.512024 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:23.511998 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" Jul 06 19:38:23.512449 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:23.512045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk" event={"ID":"280d688c-2e79-49fc-ba50-aac982990938","Type":"ContainerDied","Data":"92036c3866906178da06088d2ced5c0e327645137392545fac33e5da79ac786c"} Jul 06 19:38:23.512449 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:23.512125 2577 scope.go:117] "RemoveContainer" containerID="76e6410ac6400d1682a0136503f1d28080ced1195bec7b5cec284674dfcbea95" Jul 06 19:38:23.531968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:23.531945 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk"] Jul 06 19:38:23.534171 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:23.534151 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-reuse-82e679-5b7489657-5ngfk"] Jul 06 19:38:25.343060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:38:25.343026 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280d688c-2e79-49fc-ba50-aac982990938" path="/var/lib/kubelet/pods/280d688c-2e79-49fc-ba50-aac982990938/volumes" Jul 06 19:39:13.848765 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:13.848714 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457"] Jul 06 19:39:13.849315 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:13.848996 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" podUID="ffeb787a-2567-42a6-8192-d91e829231bc" containerName="maas-api" containerID="cri-o://7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7" gracePeriod=30 Jul 06 19:39:14.097841 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.097810 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:39:14.219391 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.219349 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeb787a-2567-42a6-8192-d91e829231bc-openshift-service-ca\") pod \"ffeb787a-2567-42a6-8192-d91e829231bc\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " Jul 06 19:39:14.219391 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.219401 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmgwz\" (UniqueName: \"kubernetes.io/projected/ffeb787a-2567-42a6-8192-d91e829231bc-kube-api-access-hmgwz\") pod \"ffeb787a-2567-42a6-8192-d91e829231bc\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " Jul 06 19:39:14.219648 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.219423 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffeb787a-2567-42a6-8192-d91e829231bc-maas-api-tls\") pod \"ffeb787a-2567-42a6-8192-d91e829231bc\" (UID: \"ffeb787a-2567-42a6-8192-d91e829231bc\") " Jul 06 19:39:14.219885 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.219844 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffeb787a-2567-42a6-8192-d91e829231bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffeb787a-2567-42a6-8192-d91e829231bc" (UID: "ffeb787a-2567-42a6-8192-d91e829231bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:39:14.221663 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.221619 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffeb787a-2567-42a6-8192-d91e829231bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffeb787a-2567-42a6-8192-d91e829231bc" (UID: "ffeb787a-2567-42a6-8192-d91e829231bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:39:14.221774 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.221678 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffeb787a-2567-42a6-8192-d91e829231bc-kube-api-access-hmgwz" (OuterVolumeSpecName: "kube-api-access-hmgwz") pod "ffeb787a-2567-42a6-8192-d91e829231bc" (UID: "ffeb787a-2567-42a6-8192-d91e829231bc"). InnerVolumeSpecName "kube-api-access-hmgwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:39:14.320506 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.320463 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffeb787a-2567-42a6-8192-d91e829231bc-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:39:14.320686 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.320525 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmgwz\" (UniqueName: \"kubernetes.io/projected/ffeb787a-2567-42a6-8192-d91e829231bc-kube-api-access-hmgwz\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:39:14.320686 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.320541 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffeb787a-2567-42a6-8192-d91e829231bc-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:39:14.790751 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.790716 2577 generic.go:356] "Generic (PLEG): container finished" podID="ffeb787a-2567-42a6-8192-d91e829231bc" containerID="7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7" exitCode=0 Jul 06 19:39:14.790967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.790764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" event={"ID":"ffeb787a-2567-42a6-8192-d91e829231bc","Type":"ContainerDied","Data":"7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7"} Jul 06 19:39:14.790967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.790771 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" Jul 06 19:39:14.790967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.790807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457" event={"ID":"ffeb787a-2567-42a6-8192-d91e829231bc","Type":"ContainerDied","Data":"9ec25253129a32f5923b1cf900cb94a0e5904a4faf483dfa80c1a727d7ea1b33"} Jul 06 19:39:14.790967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.790828 2577 scope.go:117] "RemoveContainer" containerID="7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7" Jul 06 19:39:14.800848 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.800830 2577 scope.go:117] "RemoveContainer" containerID="7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7" Jul 06 19:39:14.801116 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:39:14.801074 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7\": container with ID starting with 7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7 not found: ID does not exist" containerID="7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7" Jul 06 19:39:14.801219 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.801121 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7"} err="failed to get container status \"7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7\": rpc error: code = NotFound desc = could not find container \"7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7\": container with ID starting with 7c0a10a9b22bf8a779ed695eeceea89d605da0e9d44cf36c11954d067e9dedb7 not found: ID does not exist" Jul 06 19:39:14.814135 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.814108 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457"] Jul 06 19:39:14.818516 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:14.818491 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c6176e-848fdc8467-29457"] Jul 06 19:39:15.342815 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:15.342783 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffeb787a-2567-42a6-8192-d91e829231bc" path="/var/lib/kubelet/pods/ffeb787a-2567-42a6-8192-d91e829231bc/volumes" Jul 06 19:39:55.736077 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:55.736040 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj"] Jul 06 19:39:55.736687 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:39:55.736305 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" containerID="cri-o://1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e" gracePeriod=30 Jul 06 19:40:00.986447 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:00.986420 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:40:01.034301 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.034204 2577 generic.go:356] "Generic (PLEG): container finished" podID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerID="1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e" exitCode=0 Jul 06 19:40:01.034301 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.034254 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" Jul 06 19:40:01.034301 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.034276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" event={"ID":"3e3358c1-ead7-4a30-a04b-d96b08728913","Type":"ContainerDied","Data":"1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e"} Jul 06 19:40:01.034564 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.034333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj" event={"ID":"3e3358c1-ead7-4a30-a04b-d96b08728913","Type":"ContainerDied","Data":"b3a4b24841e76f61f74d6a11cb2e0543b6ee8dfbbe8647ca12b6a7eb360a824a"} Jul 06 19:40:01.034564 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.034366 2577 scope.go:117] "RemoveContainer" containerID="1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e" Jul 06 19:40:01.043668 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.043653 2577 scope.go:117] "RemoveContainer" containerID="2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e" Jul 06 19:40:01.052043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.052024 2577 scope.go:117] "RemoveContainer" containerID="1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e" Jul 06 19:40:01.052321 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:01.052304 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e\": container with ID starting with 1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e not found: ID does not exist" containerID="1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e" Jul 06 19:40:01.052384 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.052329 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e"} err="failed to get container status \"1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e\": rpc error: code = NotFound desc = could not find container \"1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e\": container with ID starting with 1af34bd64940d20b3c1d83dadd407bef360b319ea2cb5b5ba6133777444a988e not found: ID does not exist" Jul 06 19:40:01.052384 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.052347 2577 scope.go:117] "RemoveContainer" containerID="2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e" Jul 06 19:40:01.052594 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:01.052573 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e\": container with ID starting with 2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e not found: ID does not exist" containerID="2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e" Jul 06 19:40:01.052640 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.052605 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e"} err="failed to get container status \"2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e\": rpc error: code = NotFound desc = could not find container \"2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e\": container with ID starting with 2239871af317659565d58797f507616a11610f900602de6710395623a323fb8e not found: ID does not exist" Jul 06 19:40:01.110780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.110758 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-certs\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.110851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.110784 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-socket\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.110851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.110842 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-podinfo\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.110935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.110864 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl8v9\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-kube-api-access-vl8v9\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.110935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.110878 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-envoy\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.111039 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.110994 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-token\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.111117 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111062 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3358c1-ead7-4a30-a04b-d96b08728913-istiod-ca-cert\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.111117 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111000 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:01.111232 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111121 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-credential-socket\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.111232 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111149 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-data\") pod \"3e3358c1-ead7-4a30-a04b-d96b08728913\" (UID: \"3e3358c1-ead7-4a30-a04b-d96b08728913\") " Jul 06 19:40:01.111232 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111211 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:01.111486 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111457 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:01.111558 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111527 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.111558 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111547 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.111728 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111675 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3358c1-ead7-4a30-a04b-d96b08728913-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:40:01.111902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.111883 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:01.113178 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.113148 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-kube-api-access-vl8v9" (OuterVolumeSpecName: "kube-api-access-vl8v9") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "kube-api-access-vl8v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:01.113275 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.113206 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:01.113379 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.113362 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:01.113480 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.113466 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e3358c1-ead7-4a30-a04b-d96b08728913" (UID: "3e3358c1-ead7-4a30-a04b-d96b08728913"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:40:01.212328 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212307 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.212328 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212326 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3358c1-ead7-4a30-a04b-d96b08728913-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.212453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212335 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.212453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212344 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.212453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212353 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.212453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212360 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl8v9\" (UniqueName: \"kubernetes.io/projected/3e3358c1-ead7-4a30-a04b-d96b08728913-kube-api-access-vl8v9\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.212453 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.212370 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3358c1-ead7-4a30-a04b-d96b08728913-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:01.358344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.358317 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj"] Jul 06 19:40:01.362866 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:01.362843 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c6176e-openshift-default-674cdcccb9-rqjhj"] Jul 06 19:40:02.708631 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:02.708595 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt"] Jul 06 19:40:02.709097 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:02.708878 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" containerID="cri-o://1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc" gracePeriod=30 Jul 06 19:40:03.343651 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:03.343621 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" path="/var/lib/kubelet/pods/3e3358c1-ead7-4a30-a04b-d96b08728913/volumes" Jul 06 19:40:04.410817 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:04.410782 2577 patch_prober.go:28] interesting pod/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:40:04.411197 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:04.410834 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:40:07.247556 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247524 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p"] Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247897 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247909 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247919 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffeb787a-2567-42a6-8192-d91e829231bc" containerName="maas-api" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247924 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffeb787a-2567-42a6-8192-d91e829231bc" containerName="maas-api" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247938 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247943 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247956 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280d688c-2e79-49fc-ba50-aac982990938" containerName="maas-api" Jul 06 19:40:07.247967 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.247962 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="280d688c-2e79-49fc-ba50-aac982990938" containerName="maas-api" Jul 06 19:40:07.248280 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.248019 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" Jul 06 19:40:07.248280 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.248028 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="280d688c-2e79-49fc-ba50-aac982990938" containerName="maas-api" Jul 06 19:40:07.248280 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.248037 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffeb787a-2567-42a6-8192-d91e829231bc" containerName="maas-api" Jul 06 19:40:07.252395 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.252374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.255990 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.255965 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:40:07.256247 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.256230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-98bc43-serving-cert\"" Jul 06 19:40:07.262744 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.262712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p"] Jul 06 19:40:07.366918 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.366881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.367105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.366957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e60e88-1b07-4113-81d2-56cb88245f7e-openshift-service-ca\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.367105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.367017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwlks\" (UniqueName: \"kubernetes.io/projected/e6e60e88-1b07-4113-81d2-56cb88245f7e-kube-api-access-kwlks\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.468230 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.468200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.468386 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.468250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e60e88-1b07-4113-81d2-56cb88245f7e-openshift-service-ca\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.468386 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.468286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwlks\" (UniqueName: \"kubernetes.io/projected/e6e60e88-1b07-4113-81d2-56cb88245f7e-kube-api-access-kwlks\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.468508 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:07.468383 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-98bc43-serving-cert: secret "maas-api-e2e-api-a-98bc43-serving-cert" not found Jul 06 19:40:07.468508 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:07.468456 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls podName:e6e60e88-1b07-4113-81d2-56cb88245f7e nodeName:}" failed. No retries permitted until 2026-07-06 19:40:07.968434735 +0000 UTC m=+2097.291169814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls") pod "maas-api-e2e-api-a-98bc43-56458fc677-7p49p" (UID: "e6e60e88-1b07-4113-81d2-56cb88245f7e") : secret "maas-api-e2e-api-a-98bc43-serving-cert" not found Jul 06 19:40:07.469068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.469045 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e60e88-1b07-4113-81d2-56cb88245f7e-openshift-service-ca\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.477761 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.477739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwlks\" (UniqueName: \"kubernetes.io/projected/e6e60e88-1b07-4113-81d2-56cb88245f7e-kube-api-access-kwlks\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.963958 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.963903 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:40:07.973290 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.973233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:07.975450 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:07.975432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls\") pod \"maas-api-e2e-api-a-98bc43-56458fc677-7p49p\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:08.071033 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.071002 2577 generic.go:356] "Generic (PLEG): container finished" podID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerID="1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc" exitCode=0 Jul 06 19:40:08.071243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.071048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" event={"ID":"7f1b5edb-65da-498f-b1c5-2ee6dc808517","Type":"ContainerDied","Data":"1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc"} Jul 06 19:40:08.071243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.071055 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" Jul 06 19:40:08.071243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.071117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt" event={"ID":"7f1b5edb-65da-498f-b1c5-2ee6dc808517","Type":"ContainerDied","Data":"c3040ff3e9ede11bd10222459928bb48fb891fe6938c2463fc8fae032f758f4b"} Jul 06 19:40:08.071243 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.071144 2577 scope.go:117] "RemoveContainer" containerID="1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc" Jul 06 19:40:08.074351 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074330 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-data\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074478 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074383 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-certs\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074478 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074455 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istiod-ca-cert\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074601 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074485 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-socket\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074713 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074691 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:08.074798 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074694 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-envoy\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074808 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:08.074863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074826 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgkzc\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-kube-api-access-rgkzc\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074870 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:40:08.074968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074874 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-token\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.074968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-credential-socket\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.075141 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.074977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-podinfo\") pod \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\" (UID: \"7f1b5edb-65da-498f-b1c5-2ee6dc808517\") " Jul 06 19:40:08.075349 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.075327 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.075448 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.075378 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.075448 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.075396 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.075448 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.075331 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:08.075448 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.075362 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:08.077098 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.077059 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-kube-api-access-rgkzc" (OuterVolumeSpecName: "kube-api-access-rgkzc") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "kube-api-access-rgkzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:08.077388 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.077358 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:08.077493 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.077441 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:40:08.077698 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.077682 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f1b5edb-65da-498f-b1c5-2ee6dc808517" (UID: "7f1b5edb-65da-498f-b1c5-2ee6dc808517"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:08.080894 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.080877 2577 scope.go:117] "RemoveContainer" containerID="ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b" Jul 06 19:40:08.088775 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.088756 2577 scope.go:117] "RemoveContainer" containerID="1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc" Jul 06 19:40:08.089022 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:08.089005 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc\": container with ID starting with 1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc not found: ID does not exist" containerID="1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc" Jul 06 19:40:08.089105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.089029 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc"} err="failed to get container status \"1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc\": rpc error: code = NotFound desc = could not find container \"1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc\": container with ID starting with 1f15ee5182ae874009db800c14a0379faea190dc4d54005aa45644b8429c94bc not found: ID does not exist" Jul 06 19:40:08.089105 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.089045 2577 scope.go:117] "RemoveContainer" containerID="ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b" Jul 06 19:40:08.089289 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:08.089273 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b\": container with ID starting with ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b not found: ID does not exist" containerID="ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b" Jul 06 19:40:08.089329 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.089295 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b"} err="failed to get container status \"ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b\": rpc error: code = NotFound desc = could not find container \"ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b\": container with ID starting with ea4df420f9cedf5950e3a938b7d35953b2ef27811351478ff224697ff0c3754b not found: ID does not exist" Jul 06 19:40:08.164903 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.164882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:08.176521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.176495 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.176521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.176521 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgkzc\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-kube-api-access-rgkzc\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.176660 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.176531 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.176660 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.176540 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.176660 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.176549 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.176660 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.176557 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1b5edb-65da-498f-b1c5-2ee6dc808517-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:08.301805 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.301731 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p"] Jul 06 19:40:08.304116 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:40:08.304065 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e60e88_1b07_4113_81d2_56cb88245f7e.slice/crio-84ad000e352366c7877cb1c0cc7da22a19bd76335b4044a5ac646c58449ba702 WatchSource:0}: Error finding container 84ad000e352366c7877cb1c0cc7da22a19bd76335b4044a5ac646c58449ba702: Status 404 returned error can't find the container with id 84ad000e352366c7877cb1c0cc7da22a19bd76335b4044a5ac646c58449ba702 Jul 06 19:40:08.397816 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.397775 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt"] Jul 06 19:40:08.400152 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:08.400131 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-93827d-openshift-default-69bd5db969-9l7bt"] Jul 06 19:40:09.077502 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:09.077465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" event={"ID":"e6e60e88-1b07-4113-81d2-56cb88245f7e","Type":"ContainerStarted","Data":"c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96"} Jul 06 19:40:09.077649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:09.077524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" event={"ID":"e6e60e88-1b07-4113-81d2-56cb88245f7e","Type":"ContainerStarted","Data":"84ad000e352366c7877cb1c0cc7da22a19bd76335b4044a5ac646c58449ba702"} Jul 06 19:40:09.077649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:09.077556 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:09.097698 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:09.097655 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" podStartSLOduration=1.494966145 podStartE2EDuration="2.097640295s" totalImagesPullingTime="602.67415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:09.095715643 +0000 UTC m=+2098.418450737" watchObservedRunningTime="2026-07-06 19:40:09.097640295 +0000 UTC m=+2098.420375389" Jul 06 19:40:09.344014 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:09.343941 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" path="/var/lib/kubelet/pods/7f1b5edb-65da-498f-b1c5-2ee6dc808517/volumes" Jul 06 19:40:11.351575 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:11.351547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:40:11.355404 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:11.355366 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:40:11.355574 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:11.355545 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:40:11.359262 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:11.359240 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:40:12.571851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.571816 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd"] Jul 06 19:40:12.572398 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572378 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" Jul 06 19:40:12.572447 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572403 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" Jul 06 19:40:12.572447 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572418 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" Jul 06 19:40:12.572447 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572427 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" Jul 06 19:40:12.572559 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572547 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" Jul 06 19:40:12.572596 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572565 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3358c1-ead7-4a30-a04b-d96b08728913" containerName="istio-proxy" Jul 06 19:40:12.572596 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.572576 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1b5edb-65da-498f-b1c5-2ee6dc808517" containerName="istio-proxy" Jul 06 19:40:12.577391 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.577372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.580236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.580218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bad9a6-openshift-default-dockercfg-q78s8\"" Jul 06 19:40:12.588126 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.588103 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd"] Jul 06 19:40:12.712501 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-podinfo\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712659 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-envoy\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712659 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-certs\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712659 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-data\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-socket\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712780 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85764641-8fc2-487b-bc0b-17e92dcb130a-istiod-ca-cert\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712842 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w79ld\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-kube-api-access-w79ld\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712842 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-credential-socket\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.712914 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.712848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-token\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814022 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.813995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-podinfo\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-envoy\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-certs\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-data\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-socket\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814188 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85764641-8fc2-487b-bc0b-17e92dcb130a-istiod-ca-cert\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814460 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w79ld\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-kube-api-access-w79ld\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814460 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-credential-socket\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814460 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-token\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814519 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-certs\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814617 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-data\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-socket\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814847 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-credential-socket\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.814979 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.814882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85764641-8fc2-487b-bc0b-17e92dcb130a-istiod-ca-cert\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.816391 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.816369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-envoy\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.816506 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.816488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-podinfo\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.822753 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.822691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w79ld\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-kube-api-access-w79ld\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.822753 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.822737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-token\") pod \"e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:12.890271 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:12.890249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:13.025519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.025494 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd"] Jul 06 19:40:13.026733 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:40:13.026707 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85764641_8fc2_487b_bc0b_17e92dcb130a.slice/crio-8fef1dd3a034fbd8c6f7ad6541776dd7c30d7870fa6418e0247966695d2cb39c WatchSource:0}: Error finding container 8fef1dd3a034fbd8c6f7ad6541776dd7c30d7870fa6418e0247966695d2cb39c: Status 404 returned error can't find the container with id 8fef1dd3a034fbd8c6f7ad6541776dd7c30d7870fa6418e0247966695d2cb39c Jul 06 19:40:13.029037 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.029005 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:13.029159 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.029067 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:13.029159 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.029120 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:13.106367 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.106337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" event={"ID":"85764641-8fc2-487b-bc0b-17e92dcb130a","Type":"ContainerStarted","Data":"a902932afc74f8e284c4f097496adcd8a533c0b22d8a0c981be5822685f110bd"} Jul 06 19:40:13.106474 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.106394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" event={"ID":"85764641-8fc2-487b-bc0b-17e92dcb130a","Type":"ContainerStarted","Data":"8fef1dd3a034fbd8c6f7ad6541776dd7c30d7870fa6418e0247966695d2cb39c"} Jul 06 19:40:13.134686 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.128993 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podStartSLOduration=1.128972238 podStartE2EDuration="1.128972238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:13.125285277 +0000 UTC m=+2102.448020372" watchObservedRunningTime="2026-07-06 19:40:13.128972238 +0000 UTC m=+2102.451707329" Jul 06 19:40:13.891164 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:13.891125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:14.895971 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:14.895944 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:15.088893 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.088859 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:15.119308 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.119282 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:15.120189 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.120167 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:15.141423 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.141397 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k"] Jul 06 19:40:15.144767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.144749 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.148150 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.148066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-bad9a6-serving-cert\"" Jul 06 19:40:15.163833 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.163807 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k"] Jul 06 19:40:15.235466 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.235432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwnwk\" (UniqueName: \"kubernetes.io/projected/3735d547-ed29-4e61-ac5a-9b1380e14a10-kube-api-access-gwnwk\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.235636 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.235501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3735d547-ed29-4e61-ac5a-9b1380e14a10-maas-api-tls\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.235636 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.235556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3735d547-ed29-4e61-ac5a-9b1380e14a10-openshift-service-ca\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.336662 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.336633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnwk\" (UniqueName: \"kubernetes.io/projected/3735d547-ed29-4e61-ac5a-9b1380e14a10-kube-api-access-gwnwk\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.336861 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.336674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3735d547-ed29-4e61-ac5a-9b1380e14a10-maas-api-tls\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.336861 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.336706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3735d547-ed29-4e61-ac5a-9b1380e14a10-openshift-service-ca\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.337590 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.337565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3735d547-ed29-4e61-ac5a-9b1380e14a10-openshift-service-ca\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.339331 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.339307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3735d547-ed29-4e61-ac5a-9b1380e14a10-maas-api-tls\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.346767 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.346747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwnwk\" (UniqueName: \"kubernetes.io/projected/3735d547-ed29-4e61-ac5a-9b1380e14a10-kube-api-access-gwnwk\") pod \"maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.456020 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.455993 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:15.606177 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:15.606152 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k"] Jul 06 19:40:15.607914 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:40:15.607888 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3735d547_ed29_4e61_ac5a_9b1380e14a10.slice/crio-45b78943010e37d579bd5766c718893db4874bc61ab728c7f3ff12b4d92ef151 WatchSource:0}: Error finding container 45b78943010e37d579bd5766c718893db4874bc61ab728c7f3ff12b4d92ef151: Status 404 returned error can't find the container with id 45b78943010e37d579bd5766c718893db4874bc61ab728c7f3ff12b4d92ef151 Jul 06 19:40:16.125958 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:16.125919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" event={"ID":"3735d547-ed29-4e61-ac5a-9b1380e14a10","Type":"ContainerStarted","Data":"7c899ac5654cd269b14b59c12bda155529e3b788c8c2d7d51eb0ac32031c152b"} Jul 06 19:40:16.126422 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:16.125996 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:16.126422 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:16.126021 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" event={"ID":"3735d547-ed29-4e61-ac5a-9b1380e14a10","Type":"ContainerStarted","Data":"45b78943010e37d579bd5766c718893db4874bc61ab728c7f3ff12b4d92ef151"} Jul 06 19:40:16.146166 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:16.146119 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" podStartSLOduration=0.803393778 podStartE2EDuration="1.146104106s" totalImagesPullingTime="342.710328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:16.144845832 +0000 UTC m=+2105.467580939" watchObservedRunningTime="2026-07-06 19:40:16.146104106 +0000 UTC m=+2105.468839191" Jul 06 19:40:22.136053 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:22.136023 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:28.923771 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:28.923734 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p"] Jul 06 19:40:28.924300 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:28.923939 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" podUID="e6e60e88-1b07-4113-81d2-56cb88245f7e" containerName="maas-api" containerID="cri-o://c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96" gracePeriod=30 Jul 06 19:40:29.189863 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.189800 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:29.204278 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.204251 2577 generic.go:356] "Generic (PLEG): container finished" podID="e6e60e88-1b07-4113-81d2-56cb88245f7e" containerID="c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96" exitCode=0 Jul 06 19:40:29.204416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.204310 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" Jul 06 19:40:29.204416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.204320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" event={"ID":"e6e60e88-1b07-4113-81d2-56cb88245f7e","Type":"ContainerDied","Data":"c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96"} Jul 06 19:40:29.204416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.204367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p" event={"ID":"e6e60e88-1b07-4113-81d2-56cb88245f7e","Type":"ContainerDied","Data":"84ad000e352366c7877cb1c0cc7da22a19bd76335b4044a5ac646c58449ba702"} Jul 06 19:40:29.204416 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.204392 2577 scope.go:117] "RemoveContainer" containerID="c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96" Jul 06 19:40:29.215968 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.215736 2577 scope.go:117] "RemoveContainer" containerID="c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96" Jul 06 19:40:29.216421 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:29.216355 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96\": container with ID starting with c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96 not found: ID does not exist" containerID="c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96" Jul 06 19:40:29.216421 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.216394 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96"} err="failed to get container status \"c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96\": rpc error: code = NotFound desc = could not find container \"c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96\": container with ID starting with c216f680e379777db804e2b823ffebf3132b6941fbe20103a69e1849572d4c96 not found: ID does not exist" Jul 06 19:40:29.365053 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.365024 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls\") pod \"e6e60e88-1b07-4113-81d2-56cb88245f7e\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " Jul 06 19:40:29.365258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.365095 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e60e88-1b07-4113-81d2-56cb88245f7e-openshift-service-ca\") pod \"e6e60e88-1b07-4113-81d2-56cb88245f7e\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " Jul 06 19:40:29.365258 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.365120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwlks\" (UniqueName: \"kubernetes.io/projected/e6e60e88-1b07-4113-81d2-56cb88245f7e-kube-api-access-kwlks\") pod \"e6e60e88-1b07-4113-81d2-56cb88245f7e\" (UID: \"e6e60e88-1b07-4113-81d2-56cb88245f7e\") " Jul 06 19:40:29.365486 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.365456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e60e88-1b07-4113-81d2-56cb88245f7e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6e60e88-1b07-4113-81d2-56cb88245f7e" (UID: "e6e60e88-1b07-4113-81d2-56cb88245f7e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:40:29.367350 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.367311 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6e60e88-1b07-4113-81d2-56cb88245f7e" (UID: "e6e60e88-1b07-4113-81d2-56cb88245f7e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:40:29.367729 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.367698 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e60e88-1b07-4113-81d2-56cb88245f7e-kube-api-access-kwlks" (OuterVolumeSpecName: "kube-api-access-kwlks") pod "e6e60e88-1b07-4113-81d2-56cb88245f7e" (UID: "e6e60e88-1b07-4113-81d2-56cb88245f7e"). InnerVolumeSpecName "kube-api-access-kwlks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:29.466569 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.466470 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6e60e88-1b07-4113-81d2-56cb88245f7e-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:29.466569 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.466506 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e60e88-1b07-4113-81d2-56cb88245f7e-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:29.466569 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.466520 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwlks\" (UniqueName: \"kubernetes.io/projected/e6e60e88-1b07-4113-81d2-56cb88245f7e-kube-api-access-kwlks\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:29.532463 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.532423 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p"] Jul 06 19:40:29.537338 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:29.537278 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-98bc43-56458fc677-7p49p"] Jul 06 19:40:31.024899 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.024860 2577 patch_prober.go:28] interesting pod/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:53686->10.132.0.51:15021: read: connection reset by peer" start-of-body= Jul 06 19:40:31.025337 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.024935 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:53686->10.132.0.51:15021: read: connection reset by peer" Jul 06 19:40:31.223342 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.223253 2577 generic.go:356] "Generic (PLEG): container finished" podID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerID="a902932afc74f8e284c4f097496adcd8a533c0b22d8a0c981be5822685f110bd" exitCode=0 Jul 06 19:40:31.223342 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.223313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" event={"ID":"85764641-8fc2-487b-bc0b-17e92dcb130a","Type":"ContainerDied","Data":"a902932afc74f8e284c4f097496adcd8a533c0b22d8a0c981be5822685f110bd"} Jul 06 19:40:31.223770 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.223752 2577 scope.go:117] "RemoveContainer" containerID="a902932afc74f8e284c4f097496adcd8a533c0b22d8a0c981be5822685f110bd" Jul 06 19:40:31.224830 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.224804 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:31.224941 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.224878 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:31.224941 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.224924 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:31.343903 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:31.343869 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e60e88-1b07-4113-81d2-56cb88245f7e" path="/var/lib/kubelet/pods/e6e60e88-1b07-4113-81d2-56cb88245f7e/volumes" Jul 06 19:40:32.233433 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:32.233398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" event={"ID":"85764641-8fc2-487b-bc0b-17e92dcb130a","Type":"ContainerStarted","Data":"de4ad07d998563e477f2198147b3bb959cdd3e3d2dda85708c8199460b87acb9"} Jul 06 19:40:32.891176 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:32.891124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:32.891368 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:32.891351 2577 patch_prober.go:28] interesting pod/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:40:32.891425 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:32.891404 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:40:33.890882 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:33.890848 2577 patch_prober.go:28] interesting pod/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:40:33.891317 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:33.890906 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:40:34.891501 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:34.891467 2577 patch_prober.go:28] interesting pod/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:40:34.891894 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:34.891533 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:40:35.890917 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:35.890884 2577 patch_prober.go:28] interesting pod/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 19:40:35.891096 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:35.890935 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 19:40:36.018825 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.018788 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k"] Jul 06 19:40:36.019307 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.019053 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" podUID="3735d547-ed29-4e61-ac5a-9b1380e14a10" containerName="maas-api" containerID="cri-o://7c899ac5654cd269b14b59c12bda155529e3b788c8c2d7d51eb0ac32031c152b" gracePeriod=30 Jul 06 19:40:36.261529 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.261498 2577 generic.go:356] "Generic (PLEG): container finished" podID="3735d547-ed29-4e61-ac5a-9b1380e14a10" containerID="7c899ac5654cd269b14b59c12bda155529e3b788c8c2d7d51eb0ac32031c152b" exitCode=0 Jul 06 19:40:36.261658 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.261559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" event={"ID":"3735d547-ed29-4e61-ac5a-9b1380e14a10","Type":"ContainerDied","Data":"7c899ac5654cd269b14b59c12bda155529e3b788c8c2d7d51eb0ac32031c152b"} Jul 06 19:40:36.279252 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.279231 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:36.336498 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.336468 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3735d547-ed29-4e61-ac5a-9b1380e14a10-openshift-service-ca\") pod \"3735d547-ed29-4e61-ac5a-9b1380e14a10\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " Jul 06 19:40:36.336698 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.336529 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwnwk\" (UniqueName: \"kubernetes.io/projected/3735d547-ed29-4e61-ac5a-9b1380e14a10-kube-api-access-gwnwk\") pod \"3735d547-ed29-4e61-ac5a-9b1380e14a10\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " Jul 06 19:40:36.336698 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.336560 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3735d547-ed29-4e61-ac5a-9b1380e14a10-maas-api-tls\") pod \"3735d547-ed29-4e61-ac5a-9b1380e14a10\" (UID: \"3735d547-ed29-4e61-ac5a-9b1380e14a10\") " Jul 06 19:40:36.336920 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.336892 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3735d547-ed29-4e61-ac5a-9b1380e14a10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3735d547-ed29-4e61-ac5a-9b1380e14a10" (UID: "3735d547-ed29-4e61-ac5a-9b1380e14a10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:40:36.338626 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.338602 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3735d547-ed29-4e61-ac5a-9b1380e14a10-kube-api-access-gwnwk" (OuterVolumeSpecName: "kube-api-access-gwnwk") pod "3735d547-ed29-4e61-ac5a-9b1380e14a10" (UID: "3735d547-ed29-4e61-ac5a-9b1380e14a10"). InnerVolumeSpecName "kube-api-access-gwnwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:36.338717 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.338697 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3735d547-ed29-4e61-ac5a-9b1380e14a10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3735d547-ed29-4e61-ac5a-9b1380e14a10" (UID: "3735d547-ed29-4e61-ac5a-9b1380e14a10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:40:36.437450 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.437366 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3735d547-ed29-4e61-ac5a-9b1380e14a10-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:36.437450 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.437395 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwnwk\" (UniqueName: \"kubernetes.io/projected/3735d547-ed29-4e61-ac5a-9b1380e14a10-kube-api-access-gwnwk\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:36.437450 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.437405 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3735d547-ed29-4e61-ac5a-9b1380e14a10-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:36.894329 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.894252 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:36.894573 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.894556 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:36.895076 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:36.895056 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:37.268030 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:37.268008 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" Jul 06 19:40:37.268473 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:37.268056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k" event={"ID":"3735d547-ed29-4e61-ac5a-9b1380e14a10","Type":"ContainerDied","Data":"45b78943010e37d579bd5766c718893db4874bc61ab728c7f3ff12b4d92ef151"} Jul 06 19:40:37.268473 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:37.268135 2577 scope.go:117] "RemoveContainer" containerID="7c899ac5654cd269b14b59c12bda155529e3b788c8c2d7d51eb0ac32031c152b" Jul 06 19:40:37.290166 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:37.290139 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k"] Jul 06 19:40:37.294150 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:37.294131 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-bad9a6-6df4579dc4-qpd2k"] Jul 06 19:40:37.342802 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:37.342766 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3735d547-ed29-4e61-ac5a-9b1380e14a10" path="/var/lib/kubelet/pods/3735d547-ed29-4e61-ac5a-9b1380e14a10/volumes" Jul 06 19:40:42.187260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:42.187225 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd"] Jul 06 19:40:42.187676 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:42.187414 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" containerID="cri-o://de4ad07d998563e477f2198147b3bb959cdd3e3d2dda85708c8199460b87acb9" gracePeriod=30 Jul 06 19:40:43.040421 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040389 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m"] Jul 06 19:40:43.040845 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040827 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3735d547-ed29-4e61-ac5a-9b1380e14a10" containerName="maas-api" Jul 06 19:40:43.040938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040847 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3735d547-ed29-4e61-ac5a-9b1380e14a10" containerName="maas-api" Jul 06 19:40:43.040938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040859 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e60e88-1b07-4113-81d2-56cb88245f7e" containerName="maas-api" Jul 06 19:40:43.040938 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040867 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e60e88-1b07-4113-81d2-56cb88245f7e" containerName="maas-api" Jul 06 19:40:43.041103 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040972 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e60e88-1b07-4113-81d2-56cb88245f7e" containerName="maas-api" Jul 06 19:40:43.041103 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.040987 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3735d547-ed29-4e61-ac5a-9b1380e14a10" containerName="maas-api" Jul 06 19:40:43.044476 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.044455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.049162 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.049144 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bd1298-openshift-default-dockercfg-lxk58\"" Jul 06 19:40:43.065323 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.065301 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m"] Jul 06 19:40:43.092169 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a188402-c092-47c6-b5b8-1a5898654371-istio-podinfo\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092326 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-envoy\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092326 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-data\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092326 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn9s6\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-kube-api-access-gn9s6\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092456 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-certs\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092456 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-credential-socket\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092456 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-istio-token\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092572 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a188402-c092-47c6-b5b8-1a5898654371-istiod-ca-cert\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.092572 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.092541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-socket\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193431 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-envoy\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-data\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn9s6\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-kube-api-access-gn9s6\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-certs\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-credential-socket\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-istio-token\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a188402-c092-47c6-b5b8-1a5898654371-istiod-ca-cert\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-socket\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a188402-c092-47c6-b5b8-1a5898654371-istio-podinfo\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.193902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-certs\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.194406 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.193947 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-credential-socket\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.194406 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.194160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-socket\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.194406 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.194170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-data\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.194406 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.194343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a188402-c092-47c6-b5b8-1a5898654371-istiod-ca-cert\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.195959 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.195940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-envoy\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.196506 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.196489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a188402-c092-47c6-b5b8-1a5898654371-istio-podinfo\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.201796 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.201773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-istio-token\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.202282 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.202260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn9s6\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-kube-api-access-gn9s6\") pod \"e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.356138 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.356045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:43.500539 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.500503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m"] Jul 06 19:40:43.501541 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:40:43.501517 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a188402_c092_47c6_b5b8_1a5898654371.slice/crio-046cc835fb3bf2f46f65fd14319948a4d63dcb24faa2375b039ceb9fd1ab634f WatchSource:0}: Error finding container 046cc835fb3bf2f46f65fd14319948a4d63dcb24faa2375b039ceb9fd1ab634f: Status 404 returned error can't find the container with id 046cc835fb3bf2f46f65fd14319948a4d63dcb24faa2375b039ceb9fd1ab634f Jul 06 19:40:43.504058 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.504019 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:43.504161 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.504118 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:43.504201 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:43.504162 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:44.309037 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:44.308998 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" event={"ID":"6a188402-c092-47c6-b5b8-1a5898654371","Type":"ContainerStarted","Data":"ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf"} Jul 06 19:40:44.309428 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:44.309051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" event={"ID":"6a188402-c092-47c6-b5b8-1a5898654371","Type":"ContainerStarted","Data":"046cc835fb3bf2f46f65fd14319948a4d63dcb24faa2375b039ceb9fd1ab634f"} Jul 06 19:40:44.330561 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:44.330516 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podStartSLOduration=1.33050096 podStartE2EDuration="1.33050096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:44.328207213 +0000 UTC m=+2133.650942307" watchObservedRunningTime="2026-07-06 19:40:44.33050096 +0000 UTC m=+2133.653236051" Jul 06 19:40:44.356385 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:44.356356 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:44.361165 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:44.361146 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:45.314957 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:45.314923 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:45.315941 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:45.315920 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:40:47.326707 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.326679 2577 generic.go:356] "Generic (PLEG): container finished" podID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerID="de4ad07d998563e477f2198147b3bb959cdd3e3d2dda85708c8199460b87acb9" exitCode=0 Jul 06 19:40:47.327184 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.326754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" event={"ID":"85764641-8fc2-487b-bc0b-17e92dcb130a","Type":"ContainerDied","Data":"de4ad07d998563e477f2198147b3bb959cdd3e3d2dda85708c8199460b87acb9"} Jul 06 19:40:47.327184 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.326815 2577 scope.go:117] "RemoveContainer" containerID="a902932afc74f8e284c4f097496adcd8a533c0b22d8a0c981be5822685f110bd" Jul 06 19:40:47.437819 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.437798 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:47.532772 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532712 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-envoy\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.532772 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532742 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w79ld\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-kube-api-access-w79ld\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.532772 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532764 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-socket\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532800 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-data\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532815 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-token\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532838 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-credential-socket\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533018 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.532903 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-certs\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533077 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:47.533256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533174 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-podinfo\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533203 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:47.533256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533220 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85764641-8fc2-487b-bc0b-17e92dcb130a-istiod-ca-cert\") pod \"85764641-8fc2-487b-bc0b-17e92dcb130a\" (UID: \"85764641-8fc2-487b-bc0b-17e92dcb130a\") " Jul 06 19:40:47.533256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533220 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:47.533550 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533529 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.533629 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533551 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.533629 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533565 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.533629 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533612 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85764641-8fc2-487b-bc0b-17e92dcb130a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:40:47.533826 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.533803 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-data" (OuterVolumeSpecName: "istio-data") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:47.535013 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.534993 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-token" (OuterVolumeSpecName: "istio-token") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:47.535201 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.535183 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:40:47.535342 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.535318 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:40:47.535342 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.535320 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-kube-api-access-w79ld" (OuterVolumeSpecName: "kube-api-access-w79ld") pod "85764641-8fc2-487b-bc0b-17e92dcb130a" (UID: "85764641-8fc2-487b-bc0b-17e92dcb130a"). InnerVolumeSpecName "kube-api-access-w79ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:40:47.634187 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.634163 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.634187 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.634182 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85764641-8fc2-487b-bc0b-17e92dcb130a-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.634187 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.634191 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.634336 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.634199 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w79ld\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-kube-api-access-w79ld\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.634336 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.634209 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:47.634336 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:47.634216 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85764641-8fc2-487b-bc0b-17e92dcb130a-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:40:48.333481 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:48.333451 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" Jul 06 19:40:48.333989 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:48.333497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd" event={"ID":"85764641-8fc2-487b-bc0b-17e92dcb130a","Type":"ContainerDied","Data":"8fef1dd3a034fbd8c6f7ad6541776dd7c30d7870fa6418e0247966695d2cb39c"} Jul 06 19:40:48.333989 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:48.333562 2577 scope.go:117] "RemoveContainer" containerID="de4ad07d998563e477f2198147b3bb959cdd3e3d2dda85708c8199460b87acb9" Jul 06 19:40:48.355958 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:48.355934 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd"] Jul 06 19:40:48.361561 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:48.361533 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bad9a6-openshift-default-5dd4ffc87-6tjtd"] Jul 06 19:40:49.342754 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:49.342724 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" path="/var/lib/kubelet/pods/85764641-8fc2-487b-bc0b-17e92dcb130a/volumes" Jul 06 19:40:51.435345 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.435306 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb"] Jul 06 19:40:51.435884 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.435867 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" Jul 06 19:40:51.435952 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.435886 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" Jul 06 19:40:51.435952 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.435903 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" Jul 06 19:40:51.435952 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.435911 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" Jul 06 19:40:51.436136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.435991 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" Jul 06 19:40:51.436136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.436005 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="85764641-8fc2-487b-bc0b-17e92dcb130a" containerName="istio-proxy" Jul 06 19:40:51.439191 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.439169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.444142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.444107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f2694d-openshift-default-dockercfg-cp6wv\"" Jul 06 19:40:51.454344 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.454320 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb"] Jul 06 19:40:51.566782 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.566745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-socket\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.566980 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.566816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-data\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.566980 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.566842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-certs\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.566980 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.566940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ffsf\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-kube-api-access-2ffsf\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.567180 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.567018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfd46ad-7812-4c04-880b-230e6ae83a30-istiod-ca-cert\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.567180 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.567058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-envoy\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.567180 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.567102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-token\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.567180 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.567139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-credential-socket\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.567180 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.567170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-podinfo\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668635 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfd46ad-7812-4c04-880b-230e6ae83a30-istiod-ca-cert\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668813 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-envoy\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668813 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-token\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668813 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-credential-socket\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668961 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-podinfo\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668961 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-socket\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.668961 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-data\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669130 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.668981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-certs\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669130 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.669036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ffsf\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-kube-api-access-2ffsf\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669251 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.669137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-credential-socket\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669512 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.669472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfd46ad-7812-4c04-880b-230e6ae83a30-istiod-ca-cert\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669610 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.669524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-data\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669610 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.669547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-socket\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.669610 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.669584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-certs\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.671076 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.671050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-envoy\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.671334 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.671315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-podinfo\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.676889 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.676865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-token\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.677349 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.677331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ffsf\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-kube-api-access-2ffsf\") pod \"e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.753440 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.753348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:51.910981 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.910951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb"] Jul 06 19:40:51.912127 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.912070 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:51.912272 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.912162 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:51.912272 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:51.912199 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:40:52.358945 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:52.358907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" event={"ID":"7dfd46ad-7812-4c04-880b-230e6ae83a30","Type":"ContainerStarted","Data":"5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df"} Jul 06 19:40:52.359142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:52.358967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" event={"ID":"7dfd46ad-7812-4c04-880b-230e6ae83a30","Type":"ContainerStarted","Data":"dd87b5aeb7e4dd115adb6e4cd991c5a3de2afbccb17604de3db3a63ce6421bac"} Jul 06 19:40:52.380110 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:52.380046 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podStartSLOduration=1.380030625 podStartE2EDuration="1.380030625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:52.378744919 +0000 UTC m=+2141.701480013" watchObservedRunningTime="2026-07-06 19:40:52.380030625 +0000 UTC m=+2141.702765789" Jul 06 19:40:52.753796 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:52.753765 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:52.754974 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:52.754944 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:40:52.755125 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:52.754999 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:40:53.758537 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:53.758507 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:54.369005 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.368977 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:54.369886 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.369864 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:40:54.542101 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.538131 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94"] Jul 06 19:40:54.562109 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.561024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94"] Jul 06 19:40:54.562109 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.561178 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.564818 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.564792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-f2694d-serving-cert\"" Jul 06 19:40:54.565122 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.565103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\"" Jul 06 19:40:54.698310 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.698272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.698471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.698332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f13f9b-6dac-4122-8f26-d9fef9c393bb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.698471 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.698406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j6lj\" (UniqueName: \"kubernetes.io/projected/46f13f9b-6dac-4122-8f26-d9fef9c393bb-kube-api-access-2j6lj\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.799483 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.799443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f13f9b-6dac-4122-8f26-d9fef9c393bb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.799855 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.799501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j6lj\" (UniqueName: \"kubernetes.io/projected/46f13f9b-6dac-4122-8f26-d9fef9c393bb-kube-api-access-2j6lj\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.799855 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.799577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.799855 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:54.799694 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-f2694d-serving-cert: secret "maas-api-e2e-shared-b-f2694d-serving-cert" not found Jul 06 19:40:54.799855 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:40:54.799769 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls podName:46f13f9b-6dac-4122-8f26-d9fef9c393bb nodeName:}" failed. No retries permitted until 2026-07-06 19:40:55.299750698 +0000 UTC m=+2144.622485771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls") pod "maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" (UID: "46f13f9b-6dac-4122-8f26-d9fef9c393bb") : secret "maas-api-e2e-shared-b-f2694d-serving-cert" not found Jul 06 19:40:54.800225 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.800202 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f13f9b-6dac-4122-8f26-d9fef9c393bb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:54.811237 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:54.811209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j6lj\" (UniqueName: \"kubernetes.io/projected/46f13f9b-6dac-4122-8f26-d9fef9c393bb-kube-api-access-2j6lj\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:55.305156 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:55.305117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:55.307483 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:55.307454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f2694d-7445d69845-f5p94\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:55.475182 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:55.475149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:55.643576 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:55.643525 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94"] Jul 06 19:40:55.654025 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:40:55.653972 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f13f9b_6dac_4122_8f26_d9fef9c393bb.slice/crio-680ae00c64a84b3b82c8fbba87b239323c249e1a43654bca5bcfbf76f10dacbb WatchSource:0}: Error finding container 680ae00c64a84b3b82c8fbba87b239323c249e1a43654bca5bcfbf76f10dacbb: Status 404 returned error can't find the container with id 680ae00c64a84b3b82c8fbba87b239323c249e1a43654bca5bcfbf76f10dacbb Jul 06 19:40:56.381367 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:56.381308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" event={"ID":"46f13f9b-6dac-4122-8f26-d9fef9c393bb","Type":"ContainerStarted","Data":"680ae00c64a84b3b82c8fbba87b239323c249e1a43654bca5bcfbf76f10dacbb"} Jul 06 19:40:57.388362 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:57.388252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" event={"ID":"46f13f9b-6dac-4122-8f26-d9fef9c393bb","Type":"ContainerStarted","Data":"11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2"} Jul 06 19:40:57.390003 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:57.389979 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:40:57.410525 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:40:57.410480 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" podStartSLOduration=2.768194873 podStartE2EDuration="3.410462394s" totalImagesPullingTime="642.267521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:57.407986419 +0000 UTC m=+2146.730721528" watchObservedRunningTime="2026-07-06 19:40:57.410462394 +0000 UTC m=+2146.733197488" Jul 06 19:41:00.316307 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.316268 2577 patch_prober.go:28] interesting pod/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:41:00.316736 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.316330 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:41:00.406060 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.406027 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a188402-c092-47c6-b5b8-1a5898654371" containerID="ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf" exitCode=0 Jul 06 19:41:00.406248 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.406114 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" event={"ID":"6a188402-c092-47c6-b5b8-1a5898654371","Type":"ContainerDied","Data":"ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf"} Jul 06 19:41:00.406476 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.406458 2577 scope.go:117] "RemoveContainer" containerID="ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf" Jul 06 19:41:00.407456 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.407429 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:41:00.407535 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.407508 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:41:00.407576 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:00.407553 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:41:01.416589 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:01.416553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" event={"ID":"6a188402-c092-47c6-b5b8-1a5898654371","Type":"ContainerStarted","Data":"964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f"} Jul 06 19:41:02.357312 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:02.357268 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:41:02.357532 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:02.357446 2577 patch_prober.go:28] interesting pod/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:41:02.357532 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:02.357489 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:41:03.356752 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:03.356656 2577 patch_prober.go:28] interesting pod/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:41:03.357256 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:03.356754 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:41:04.356840 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:04.356803 2577 patch_prober.go:28] interesting pod/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:41:04.357454 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:04.357424 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:41:04.405825 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:04.405798 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:41:05.357030 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:05.356995 2577 patch_prober.go:28] interesting pod/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 19:41:05.357430 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:05.357044 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 19:41:06.361093 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:06.361052 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:41:06.361460 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:06.361441 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:41:06.362193 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:06.362172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:41:07.486933 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:07.486906 2577 generic.go:356] "Generic (PLEG): container finished" podID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerID="5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df" exitCode=0 Jul 06 19:41:07.487273 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:07.486974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" event={"ID":"7dfd46ad-7812-4c04-880b-230e6ae83a30","Type":"ContainerDied","Data":"5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df"} Jul 06 19:41:07.487482 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:07.487466 2577 scope.go:117] "RemoveContainer" containerID="5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df" Jul 06 19:41:07.488527 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:07.488500 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:41:07.488612 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:07.488573 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:41:07.488649 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:07.488616 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:41:08.495523 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:08.495487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" event={"ID":"7dfd46ad-7812-4c04-880b-230e6ae83a30","Type":"ContainerStarted","Data":"2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a"} Jul 06 19:41:08.753752 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:08.753683 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:41:08.755015 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:08.754990 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:41:08.755172 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:08.755040 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:41:09.369684 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:09.369655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:41:09.754545 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:09.754514 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:41:09.754962 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:09.754564 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:41:10.754666 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:10.754624 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:41:10.755113 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:10.754699 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:41:11.754211 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:11.754125 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:41:11.754211 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:11.754177 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:41:12.753911 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:12.753870 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 19:41:12.754399 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:12.753938 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 19:41:13.757337 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:13.757312 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:41:13.758365 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:41:13.758345 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:45:11.387851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:45:11.387814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:45:11.391607 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:45:11.391586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:45:11.394592 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:45:11.394574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:45:11.398059 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:45:11.398044 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjxq8_7f59943a-5b9e-42e5-95af-df6d051b0988/ovn-acl-logging/0.log" Jul 06 19:46:48.530475 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:48.530442 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m"] Jul 06 19:46:48.531263 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:48.530696 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" containerID="cri-o://964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f" gracePeriod=30 Jul 06 19:46:49.630540 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:49.630506 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94"] Jul 06 19:46:49.630985 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:49.630738 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" podUID="46f13f9b-6dac-4122-8f26-d9fef9c393bb" containerName="maas-api" containerID="cri-o://11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2" gracePeriod=30 Jul 06 19:46:49.884682 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:49.884626 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:46:50.013952 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.013927 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls\") pod \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " Jul 06 19:46:50.014181 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.013961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f13f9b-6dac-4122-8f26-d9fef9c393bb-openshift-service-ca\") pod \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " Jul 06 19:46:50.014181 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.014036 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j6lj\" (UniqueName: \"kubernetes.io/projected/46f13f9b-6dac-4122-8f26-d9fef9c393bb-kube-api-access-2j6lj\") pod \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\" (UID: \"46f13f9b-6dac-4122-8f26-d9fef9c393bb\") " Jul 06 19:46:50.014395 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.014372 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f13f9b-6dac-4122-8f26-d9fef9c393bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46f13f9b-6dac-4122-8f26-d9fef9c393bb" (UID: "46f13f9b-6dac-4122-8f26-d9fef9c393bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:46:50.016108 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.016069 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46f13f9b-6dac-4122-8f26-d9fef9c393bb" (UID: "46f13f9b-6dac-4122-8f26-d9fef9c393bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:46:50.016189 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.016137 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f13f9b-6dac-4122-8f26-d9fef9c393bb-kube-api-access-2j6lj" (OuterVolumeSpecName: "kube-api-access-2j6lj") pod "46f13f9b-6dac-4122-8f26-d9fef9c393bb" (UID: "46f13f9b-6dac-4122-8f26-d9fef9c393bb"). InnerVolumeSpecName "kube-api-access-2j6lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:46:50.115009 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.114986 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46f13f9b-6dac-4122-8f26-d9fef9c393bb-maas-api-tls\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:50.115009 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.115008 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f13f9b-6dac-4122-8f26-d9fef9c393bb-openshift-service-ca\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:50.115162 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.115019 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j6lj\" (UniqueName: \"kubernetes.io/projected/46f13f9b-6dac-4122-8f26-d9fef9c393bb-kube-api-access-2j6lj\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:50.332860 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.332828 2577 generic.go:356] "Generic (PLEG): container finished" podID="46f13f9b-6dac-4122-8f26-d9fef9c393bb" containerID="11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2" exitCode=0 Jul 06 19:46:50.333043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.332869 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" Jul 06 19:46:50.333043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.332912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" event={"ID":"46f13f9b-6dac-4122-8f26-d9fef9c393bb","Type":"ContainerDied","Data":"11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2"} Jul 06 19:46:50.333043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.332970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94" event={"ID":"46f13f9b-6dac-4122-8f26-d9fef9c393bb","Type":"ContainerDied","Data":"680ae00c64a84b3b82c8fbba87b239323c249e1a43654bca5bcfbf76f10dacbb"} Jul 06 19:46:50.333043 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.332997 2577 scope.go:117] "RemoveContainer" containerID="11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2" Jul 06 19:46:50.342446 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.342431 2577 scope.go:117] "RemoveContainer" containerID="11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2" Jul 06 19:46:50.342687 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:46:50.342670 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2\": container with ID starting with 11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2 not found: ID does not exist" containerID="11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2" Jul 06 19:46:50.342733 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.342694 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2"} err="failed to get container status \"11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2\": rpc error: code = NotFound desc = could not find container \"11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2\": container with ID starting with 11845d307f115b9f08c4cf0a545c5ea55673a4c2d75f1dbbe146fb8b99bf13f2 not found: ID does not exist" Jul 06 19:46:50.356807 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.356782 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94"] Jul 06 19:46:50.358902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:50.358877 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f2694d-7445d69845-f5p94"] Jul 06 19:46:51.343219 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:51.343187 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f13f9b-6dac-4122-8f26-d9fef9c393bb" path="/var/lib/kubelet/pods/46f13f9b-6dac-4122-8f26-d9fef9c393bb/volumes" Jul 06 19:46:51.363820 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:51.363791 2577 patch_prober.go:28] interesting pod/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:46:51.363951 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:51.363844 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:46:53.784325 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.784299 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:46:53.849877 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849820 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-certs\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.849877 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849860 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-credential-socket\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849883 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-istio-token\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849902 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-socket\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849948 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a188402-c092-47c6-b5b8-1a5898654371-istiod-ca-cert\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-envoy\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850048 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.849984 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-data\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850334 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850049 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a188402-c092-47c6-b5b8-1a5898654371-istio-podinfo\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.850334 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850153 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:46:53.850334 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850186 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:46:53.850482 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850372 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.850482 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850392 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.850482 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850448 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:46:53.850482 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850380 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a188402-c092-47c6-b5b8-1a5898654371-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:46:53.850889 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.850866 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:46:53.852004 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.851980 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:46:53.852173 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.852153 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a188402-c092-47c6-b5b8-1a5898654371-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:46:53.852345 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.852329 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:46:53.950902 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.950881 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn9s6\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-kube-api-access-gn9s6\") pod \"6a188402-c092-47c6-b5b8-1a5898654371\" (UID: \"6a188402-c092-47c6-b5b8-1a5898654371\") " Jul 06 19:46:53.951029 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.951017 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a188402-c092-47c6-b5b8-1a5898654371-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.951074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.951031 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.951074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.951039 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.951074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.951047 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a188402-c092-47c6-b5b8-1a5898654371-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.951074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.951054 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.951074 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.951062 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a188402-c092-47c6-b5b8-1a5898654371-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:53.952519 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:53.952501 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-kube-api-access-gn9s6" (OuterVolumeSpecName: "kube-api-access-gn9s6") pod "6a188402-c092-47c6-b5b8-1a5898654371" (UID: "6a188402-c092-47c6-b5b8-1a5898654371"). InnerVolumeSpecName "kube-api-access-gn9s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:46:54.052052 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.052027 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn9s6\" (UniqueName: \"kubernetes.io/projected/6a188402-c092-47c6-b5b8-1a5898654371-kube-api-access-gn9s6\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:46:54.356004 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.355967 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a188402-c092-47c6-b5b8-1a5898654371" containerID="964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f" exitCode=0 Jul 06 19:46:54.356194 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.356014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" event={"ID":"6a188402-c092-47c6-b5b8-1a5898654371","Type":"ContainerDied","Data":"964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f"} Jul 06 19:46:54.356194 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.356037 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" Jul 06 19:46:54.356194 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.356063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m" event={"ID":"6a188402-c092-47c6-b5b8-1a5898654371","Type":"ContainerDied","Data":"046cc835fb3bf2f46f65fd14319948a4d63dcb24faa2375b039ceb9fd1ab634f"} Jul 06 19:46:54.356194 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.356108 2577 scope.go:117] "RemoveContainer" containerID="964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f" Jul 06 19:46:54.366038 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.366019 2577 scope.go:117] "RemoveContainer" containerID="ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf" Jul 06 19:46:54.373872 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.373856 2577 scope.go:117] "RemoveContainer" containerID="964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f" Jul 06 19:46:54.374146 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:46:54.374125 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f\": container with ID starting with 964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f not found: ID does not exist" containerID="964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f" Jul 06 19:46:54.374207 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.374155 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f"} err="failed to get container status \"964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f\": rpc error: code = NotFound desc = could not find container \"964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f\": container with ID starting with 964e31c6dfd0f6153ed8b623ad822bb7f2eccd1b4d28875d411bf2bbc6d0b21f not found: ID does not exist" Jul 06 19:46:54.374207 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.374172 2577 scope.go:117] "RemoveContainer" containerID="ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf" Jul 06 19:46:54.374411 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:46:54.374394 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf\": container with ID starting with ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf not found: ID does not exist" containerID="ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf" Jul 06 19:46:54.374466 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.374420 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf"} err="failed to get container status \"ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf\": rpc error: code = NotFound desc = could not find container \"ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf\": container with ID starting with ab64fe63bb73b10c380c7799fb170f227582052c1822b2beb6ae1e04c29571bf not found: ID does not exist" Jul 06 19:46:54.384483 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.381833 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m"] Jul 06 19:46:54.387279 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:54.387255 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bd1298-openshift-default-776957686c-6jc8m"] Jul 06 19:46:55.343669 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:55.343633 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a188402-c092-47c6-b5b8-1a5898654371" path="/var/lib/kubelet/pods/6a188402-c092-47c6-b5b8-1a5898654371/volumes" Jul 06 19:46:55.526582 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:55.526546 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb"] Jul 06 19:46:55.526827 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:55.526798 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" containerID="cri-o://2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a" gracePeriod=30 Jul 06 19:46:58.760389 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:58.760356 2577 patch_prober.go:28] interesting pod/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:46:58.760772 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:46:58.760413 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:47:00.778331 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.778306 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:47:00.800944 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.800866 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfd46ad-7812-4c04-880b-230e6ae83a30-istiod-ca-cert\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.800944 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.800938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-token\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801198 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.800967 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-socket\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801198 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.800992 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-podinfo\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801198 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801025 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-envoy\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801376 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801240 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-data\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801376 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801279 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ffsf\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-kube-api-access-2ffsf\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801376 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801303 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-credential-socket\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801376 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801362 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-certs\") pod \"7dfd46ad-7812-4c04-880b-230e6ae83a30\" (UID: \"7dfd46ad-7812-4c04-880b-230e6ae83a30\") " Jul 06 19:47:00.801584 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801552 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:47:00.801867 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801774 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:47:00.801998 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.801892 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfd46ad-7812-4c04-880b-230e6ae83a30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:47:00.802373 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.802341 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:47:00.803142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.803039 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.803142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.803063 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-credential-socket\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.803142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.803078 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-workload-certs\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.803142 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.803111 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dfd46ad-7812-4c04-880b-230e6ae83a30-istiod-ca-cert\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.803520 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.803493 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-data" (OuterVolumeSpecName: "istio-data") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:47:00.804264 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.804058 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-token" (OuterVolumeSpecName: "istio-token") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:47:00.804264 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.804208 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:47:00.804421 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.804370 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-kube-api-access-2ffsf" (OuterVolumeSpecName: "kube-api-access-2ffsf") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "kube-api-access-2ffsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:47:00.804490 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.804424 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7dfd46ad-7812-4c04-880b-230e6ae83a30" (UID: "7dfd46ad-7812-4c04-880b-230e6ae83a30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:47:00.903935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.903911 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-data\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.903935 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.903934 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ffsf\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-kube-api-access-2ffsf\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.904068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.903944 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-token\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.904068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.903954 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-podinfo\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:00.904068 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:00.903962 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dfd46ad-7812-4c04-880b-230e6ae83a30-istio-envoy\") on node \"ip-10-0-142-12.ec2.internal\" DevicePath \"\"" Jul 06 19:47:01.391521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.391485 2577 generic.go:356] "Generic (PLEG): container finished" podID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerID="2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a" exitCode=0 Jul 06 19:47:01.391683 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.391536 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" Jul 06 19:47:01.391683 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.391537 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" event={"ID":"7dfd46ad-7812-4c04-880b-230e6ae83a30","Type":"ContainerDied","Data":"2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a"} Jul 06 19:47:01.391806 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.391685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb" event={"ID":"7dfd46ad-7812-4c04-880b-230e6ae83a30","Type":"ContainerDied","Data":"dd87b5aeb7e4dd115adb6e4cd991c5a3de2afbccb17604de3db3a63ce6421bac"} Jul 06 19:47:01.391806 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.391717 2577 scope.go:117] "RemoveContainer" containerID="2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a" Jul 06 19:47:01.400452 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.400435 2577 scope.go:117] "RemoveContainer" containerID="5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df" Jul 06 19:47:01.408223 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.408207 2577 scope.go:117] "RemoveContainer" containerID="2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a" Jul 06 19:47:01.408497 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:47:01.408469 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a\": container with ID starting with 2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a not found: ID does not exist" containerID="2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a" Jul 06 19:47:01.408573 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.408499 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a"} err="failed to get container status \"2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a\": rpc error: code = NotFound desc = could not find container \"2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a\": container with ID starting with 2d4e100456e5ba7480eb2fd11f8209d246da2aca83d137a742ad0ef2e77a204a not found: ID does not exist" Jul 06 19:47:01.408573 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.408518 2577 scope.go:117] "RemoveContainer" containerID="5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df" Jul 06 19:47:01.408807 ip-10-0-142-12 kubenswrapper[2577]: E0706 19:47:01.408786 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df\": container with ID starting with 5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df not found: ID does not exist" containerID="5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df" Jul 06 19:47:01.408876 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.408816 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df"} err="failed to get container status \"5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df\": rpc error: code = NotFound desc = could not find container \"5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df\": container with ID starting with 5bc21d1499cd15488de264445dc66f85539c953d71edb077cb7466851850a6df not found: ID does not exist" Jul 06 19:47:01.413528 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.413508 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb"] Jul 06 19:47:01.417121 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:01.417069 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f2694d-openshift-default-744b48c47-wrflb"] Jul 06 19:47:02.008725 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:02.008698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp_e3fec42a-1279-450c-91ea-5252d7fc8cb5/copy-manifests/0.log" Jul 06 19:47:02.016359 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:02.016335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp_e3fec42a-1279-450c-91ea-5252d7fc8cb5/manager/0.log" Jul 06 19:47:03.192708 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.192628 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg_20c6839b-5641-4eaf-ae88-dda01f8d6f85/extract/0.log" Jul 06 19:47:03.197925 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.197902 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg_20c6839b-5641-4eaf-ae88-dda01f8d6f85/util/0.log" Jul 06 19:47:03.203716 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.203694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg_20c6839b-5641-4eaf-ae88-dda01f8d6f85/pull/0.log" Jul 06 19:47:03.318991 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.318970 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g_bc2dd636-e20d-4867-9bdb-3ad487924597/util/0.log" Jul 06 19:47:03.324790 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.324772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g_bc2dd636-e20d-4867-9bdb-3ad487924597/pull/0.log" Jul 06 19:47:03.330320 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.330304 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g_bc2dd636-e20d-4867-9bdb-3ad487924597/extract/0.log" Jul 06 19:47:03.343464 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.343445 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" path="/var/lib/kubelet/pods/7dfd46ad-7812-4c04-880b-230e6ae83a30/volumes" Jul 06 19:47:03.444273 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.444214 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn_de092c59-695f-4042-a1b1-6e6115671280/util/0.log" Jul 06 19:47:03.450443 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.450422 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn_de092c59-695f-4042-a1b1-6e6115671280/pull/0.log" Jul 06 19:47:03.456587 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.456566 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn_de092c59-695f-4042-a1b1-6e6115671280/extract/0.log" Jul 06 19:47:03.576012 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.575989 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m_fc0008fe-cb74-4de3-a9c0-8082bb64f408/util/0.log" Jul 06 19:47:03.582227 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.582206 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m_fc0008fe-cb74-4de3-a9c0-8082bb64f408/pull/0.log" Jul 06 19:47:03.588488 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:03.588472 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m_fc0008fe-cb74-4de3-a9c0-8082bb64f408/extract/0.log" Jul 06 19:47:04.329494 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:04.329462 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8bxq5_589cee41-8282-44ef-a670-88140ca2fa62/manager/0.log" Jul 06 19:47:05.064722 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:05.064692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7vvlq_56cd1a43-dadc-413a-8303-6056593d5c1c/discovery/0.log" Jul 06 19:47:05.776670 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:05.776639 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f65c66c8f-qrlzn_8347f51f-8584-4298-9ca9-c34545507611/router/0.log" Jul 06 19:47:06.271665 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:06.271634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-n9zvv_52b5192f-1fdc-4783-bcac-729e0304d0f1/main/0.log" Jul 06 19:47:06.387851 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:06.387826 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hgsgs_6e2ddf47-2d85-4032-b446-c7252c9fb9d9/main/0.log" Jul 06 19:47:14.149791 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:14.149751 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7l5n8_a1b22251-5299-42cf-9373-759be5b5ae9c/global-pull-secret-syncer/0.log" Jul 06 19:47:14.305801 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:14.305771 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wcmdx_eb46a76a-5cba-483c-9567-d1a84ed73e5a/konnectivity-agent/0.log" Jul 06 19:47:14.392040 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:14.392017 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-12.ec2.internal_3cf9d28c09d100896579d38a5deeb770/haproxy/0.log" Jul 06 19:47:19.501073 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.501038 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg_20c6839b-5641-4eaf-ae88-dda01f8d6f85/extract/0.log" Jul 06 19:47:19.519343 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.519323 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg_20c6839b-5641-4eaf-ae88-dda01f8d6f85/util/0.log" Jul 06 19:47:19.540688 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.540668 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7glg_20c6839b-5641-4eaf-ae88-dda01f8d6f85/pull/0.log" Jul 06 19:47:19.576475 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.576453 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g_bc2dd636-e20d-4867-9bdb-3ad487924597/extract/0.log" Jul 06 19:47:19.597903 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.597884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g_bc2dd636-e20d-4867-9bdb-3ad487924597/util/0.log" Jul 06 19:47:19.616206 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.616186 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hkb2g_bc2dd636-e20d-4867-9bdb-3ad487924597/pull/0.log" Jul 06 19:47:19.650212 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.650196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn_de092c59-695f-4042-a1b1-6e6115671280/extract/0.log" Jul 06 19:47:19.679049 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.679028 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn_de092c59-695f-4042-a1b1-6e6115671280/util/0.log" Jul 06 19:47:19.698675 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.698651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737mxvn_de092c59-695f-4042-a1b1-6e6115671280/pull/0.log" Jul 06 19:47:19.726358 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.726335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m_fc0008fe-cb74-4de3-a9c0-8082bb64f408/extract/0.log" Jul 06 19:47:19.744538 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.744506 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m_fc0008fe-cb74-4de3-a9c0-8082bb64f408/util/0.log" Jul 06 19:47:19.762562 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:19.762479 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16sd2m_fc0008fe-cb74-4de3-a9c0-8082bb64f408/pull/0.log" Jul 06 19:47:20.415106 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:20.415060 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8bxq5_589cee41-8282-44ef-a670-88140ca2fa62/manager/0.log" Jul 06 19:47:22.164751 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.164711 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/alertmanager/0.log" Jul 06 19:47:22.188104 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.188062 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/config-reloader/0.log" Jul 06 19:47:22.211598 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.211557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/kube-rbac-proxy-web/0.log" Jul 06 19:47:22.231695 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.231675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/kube-rbac-proxy/0.log" Jul 06 19:47:22.264039 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.264017 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/kube-rbac-proxy-metric/0.log" Jul 06 19:47:22.284196 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.284180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/prom-label-proxy/0.log" Jul 06 19:47:22.304642 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.304622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_286810fc-7c84-4325-9664-3eb90428d31b/init-config-reloader/0.log" Jul 06 19:47:22.351864 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.351832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-5clbg_d56bb270-2e88-4e18-8586-6232d36fcb69/cluster-monitoring-operator/0.log" Jul 06 19:47:22.515684 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.515616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m8p6_e9ca91b1-7f30-48f7-89dc-6ba724f0299f/node-exporter/0.log" Jul 06 19:47:22.535437 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.535416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m8p6_e9ca91b1-7f30-48f7-89dc-6ba724f0299f/kube-rbac-proxy/0.log" Jul 06 19:47:22.555923 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:22.555909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m8p6_e9ca91b1-7f30-48f7-89dc-6ba724f0299f/init-textfile/0.log" Jul 06 19:47:23.024259 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.024225 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c6d4d6b7-zzmqm_f207c4ce-51c1-44a4-8761-bbb750d0440d/telemeter-client/0.log" Jul 06 19:47:23.047462 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.047442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c6d4d6b7-zzmqm_f207c4ce-51c1-44a4-8761-bbb750d0440d/reload/0.log" Jul 06 19:47:23.065440 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.065413 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c6d4d6b7-zzmqm_f207c4ce-51c1-44a4-8761-bbb750d0440d/kube-rbac-proxy/0.log" Jul 06 19:47:23.899487 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899456 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-976df/perf-node-gather-daemonset-m28g5"] Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899800 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899810 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899820 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f13f9b-6dac-4122-8f26-d9fef9c393bb" containerName="maas-api" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899827 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f13f9b-6dac-4122-8f26-d9fef9c393bb" containerName="maas-api" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899838 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899843 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899850 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" Jul 06 19:47:23.899856 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899856 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" Jul 06 19:47:23.900136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899868 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" Jul 06 19:47:23.900136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899873 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" Jul 06 19:47:23.900136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899936 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a188402-c092-47c6-b5b8-1a5898654371" containerName="istio-proxy" Jul 06 19:47:23.900136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899943 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfd46ad-7812-4c04-880b-230e6ae83a30" containerName="istio-proxy" Jul 06 19:47:23.900136 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.899951 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f13f9b-6dac-4122-8f26-d9fef9c393bb" containerName="maas-api" Jul 06 19:47:23.903103 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.903065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:23.906038 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.906013 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-976df\"/\"openshift-service-ca.crt\"" Jul 06 19:47:23.906197 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.906041 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-976df\"/\"kube-root-ca.crt\"" Jul 06 19:47:23.907281 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.907264 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-976df\"/\"default-dockercfg-dhsqh\"" Jul 06 19:47:23.911998 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.911978 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-976df/perf-node-gather-daemonset-m28g5"] Jul 06 19:47:23.995910 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.995868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sffh\" (UniqueName: \"kubernetes.io/projected/429d7625-9baf-492e-b5e3-4e3b04dbbe52-kube-api-access-5sffh\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:23.996107 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.995936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-sys\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:23.996107 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.995973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-lib-modules\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:23.996107 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.995998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-podres\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:23.996107 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:23.996013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-proc\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097075 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sffh\" (UniqueName: \"kubernetes.io/projected/429d7625-9baf-492e-b5e3-4e3b04dbbe52-kube-api-access-5sffh\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-sys\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-lib-modules\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-podres\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-proc\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097260 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-sys\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097423 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-proc\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097423 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-lib-modules\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.097423 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.097328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/429d7625-9baf-492e-b5e3-4e3b04dbbe52-podres\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.104888 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.104855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sffh\" (UniqueName: \"kubernetes.io/projected/429d7625-9baf-492e-b5e3-4e3b04dbbe52-kube-api-access-5sffh\") pod \"perf-node-gather-daemonset-m28g5\" (UID: \"429d7625-9baf-492e-b5e3-4e3b04dbbe52\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.213524 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.213425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.342527 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.342502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-976df/perf-node-gather-daemonset-m28g5"] Jul 06 19:47:24.344648 ip-10-0-142-12 kubenswrapper[2577]: W0706 19:47:24.344624 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod429d7625_9baf_492e_b5e3_4e3b04dbbe52.slice/crio-068f934fd54ef108cb7a6ab3157fc76e7bc511cd85c56b7e08f1557bc3766dc0 WatchSource:0}: Error finding container 068f934fd54ef108cb7a6ab3157fc76e7bc511cd85c56b7e08f1557bc3766dc0: Status 404 returned error can't find the container with id 068f934fd54ef108cb7a6ab3157fc76e7bc511cd85c56b7e08f1557bc3766dc0 Jul 06 19:47:24.349517 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.349500 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-nk9xl_08675e57-5f60-4adc-9155-69928a3bc98f/networking-console-plugin/0.log" Jul 06 19:47:24.513521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.513452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" event={"ID":"429d7625-9baf-492e-b5e3-4e3b04dbbe52","Type":"ContainerStarted","Data":"e6e6106931ee3a4f63e9febbaf9db7f931cdef1929529a01e712a5089f2221e3"} Jul 06 19:47:24.513521 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.513511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" event={"ID":"429d7625-9baf-492e-b5e3-4e3b04dbbe52","Type":"ContainerStarted","Data":"068f934fd54ef108cb7a6ab3157fc76e7bc511cd85c56b7e08f1557bc3766dc0"} Jul 06 19:47:24.513670 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.513551 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:24.530051 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.530012 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" podStartSLOduration=1.5299975730000002 podStartE2EDuration="1.529997573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:47:24.528529072 +0000 UTC m=+2533.851264167" watchObservedRunningTime="2026-07-06 19:47:24.529997573 +0000 UTC m=+2533.852732666" Jul 06 19:47:24.862437 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.862355 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/2.log" Jul 06 19:47:24.872368 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:24.872346 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4zrmx_4d328db8-9434-4028-b5be-112a19959976/console-operator/3.log" Jul 06 19:47:25.853247 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:25.853219 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-j85zh_ccf23230-2365-41e2-b5e4-d8c093fdf575/volume-data-source-validator/0.log" Jul 06 19:47:26.868518 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:26.868485 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qw8z8_35bf50e3-0cef-4f19-ac1a-db69fdd210c3/dns/0.log" Jul 06 19:47:26.895436 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:26.890228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qw8z8_35bf50e3-0cef-4f19-ac1a-db69fdd210c3/kube-rbac-proxy/0.log" Jul 06 19:47:26.951941 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:26.951910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4xg6g_a669b24a-1165-42d2-b60f-8bc7255f85b9/dns-node-resolver/0.log" Jul 06 19:47:27.601023 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:27.600997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lxg4q_75e44a91-97d0-4697-86f9-d018aa5972d5/node-ca/0.log" Jul 06 19:47:28.692484 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:28.692448 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7vvlq_56cd1a43-dadc-413a-8303-6056593d5c1c/discovery/0.log" Jul 06 19:47:28.925236 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:28.925208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f65c66c8f-qrlzn_8347f51f-8584-4298-9ca9-c34545507611/router/0.log" Jul 06 19:47:29.611645 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:29.611611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wps7n_d9fe1e53-1b0a-40c8-84be-fb9c4dbe9392/serve-healthcheck-canary/0.log" Jul 06 19:47:30.062551 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:30.062522 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-t8kjl_977afa96-c2d6-4d9f-91aa-25bcba2a898a/insights-operator/0.log" Jul 06 19:47:30.063483 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:30.063464 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-t8kjl_977afa96-c2d6-4d9f-91aa-25bcba2a898a/insights-operator/1.log" Jul 06 19:47:30.143642 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:30.143623 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5g6l_5911212a-ad7f-476f-8d32-c0dd65ac61ae/kube-rbac-proxy/0.log" Jul 06 19:47:30.160464 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:30.160446 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5g6l_5911212a-ad7f-476f-8d32-c0dd65ac61ae/exporter/0.log" Jul 06 19:47:30.178883 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:30.178860 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5g6l_5911212a-ad7f-476f-8d32-c0dd65ac61ae/extractor/0.log" Jul 06 19:47:30.528407 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:30.528380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-976df/perf-node-gather-daemonset-m28g5" Jul 06 19:47:32.943387 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:32.943352 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp_e3fec42a-1279-450c-91ea-5252d7fc8cb5/manager/0.log" Jul 06 19:47:32.962061 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:32.962032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-2dmtp_e3fec42a-1279-450c-91ea-5252d7fc8cb5/copy-manifests/0.log" Jul 06 19:47:34.597769 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:34.597721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7995d775b8-28lnc_a9159683-6187-4008-bc26-9eac55e28969/manager/0.log" Jul 06 19:47:34.863746 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:34.863665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7vvlq_56cd1a43-dadc-413a-8303-6056593d5c1c/discovery/0.log" Jul 06 19:47:35.031196 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:35.031166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f65c66c8f-qrlzn_8347f51f-8584-4298-9ca9-c34545507611/router/0.log" Jul 06 19:47:36.380980 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:36.380935 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7vvlq_56cd1a43-dadc-413a-8303-6056593d5c1c/discovery/0.log" Jul 06 19:47:36.557353 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:36.557324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f65c66c8f-qrlzn_8347f51f-8584-4298-9ca9-c34545507611/router/0.log" Jul 06 19:47:39.487620 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:39.487585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-6hdm9_78ca1af4-e22b-4875-98e6-b538823054b6/migrator/0.log" Jul 06 19:47:39.505094 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:39.505051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-6hdm9_78ca1af4-e22b-4875-98e6-b538823054b6/graceful-termination/0.log" Jul 06 19:47:39.841624 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:39.841582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kmb2b_eb2ff725-e976-42e1-ac97-c0b0d150e281/kube-storage-version-migrator-operator/1.log" Jul 06 19:47:39.843378 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:39.843355 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kmb2b_eb2ff725-e976-42e1-ac97-c0b0d150e281/kube-storage-version-migrator-operator/0.log" Jul 06 19:47:40.782415 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.782383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2cr9z_1a461fdf-115d-46c3-8bde-d9bc2e953182/kube-multus/0.log" Jul 06 19:47:40.804407 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.804385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/kube-multus-additional-cni-plugins/0.log" Jul 06 19:47:40.826457 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.826428 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/egress-router-binary-copy/0.log" Jul 06 19:47:40.851333 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.851308 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/cni-plugins/0.log" Jul 06 19:47:40.870839 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.870814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/bond-cni-plugin/0.log" Jul 06 19:47:40.895940 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.895917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/routeoverride-cni/0.log" Jul 06 19:47:40.921280 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.921258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/whereabouts-cni-bincopy/0.log" Jul 06 19:47:40.950113 ip-10-0-142-12 kubenswrapper[2577]: I0706 19:47:40.950068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5kcdz_e21d6797-d239-4c0c-9446-0603259981b4/whereabouts-cni/0.log"